-- Logs begin at Wed 2022-08-24 09:08:56 UTC, end at Wed 2022-08-24 10:17:25 UTC. -- Aug 24 09:45:25.109341 dv-cinder-854272-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 09:45:25.118867 dv-cinder-854272-2-smb devstack@keystone.service[81523]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 09:45:25 2022] *** Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: nodename: dv-cinder-854272-2-smb Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: machine: x86_64 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: clock source: unix Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: pcre jit disabled Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: detected number of CPU cores: 4 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: current working directory: / Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: detected binary path: /usr/bin/uwsgi-core Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: your processes number limit is 47680 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: your memory page size is 4096 bytes Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: detected max file descriptor number: 2048 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: lock engine: pthread robust mutexes Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: thunder lock: enabled Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 09:45:25.125179 dv-cinder-854272-2-smb devstack@keystone.service[81523]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 09:45:25.160787 dv-cinder-854272-2-smb devstack@keystone.service[81523]: Python main interpreter initialized at 0x5638a6c5f9c0 Aug 24 09:45:25.160787 dv-cinder-854272-2-smb devstack@keystone.service[81523]: python threads support enabled Aug 24 09:45:25.160787 dv-cinder-854272-2-smb devstack@keystone.service[81523]: your server socket listen backlog is limited to 100 connections Aug 24 09:45:25.160787 dv-cinder-854272-2-smb devstack@keystone.service[81523]: your mercy for graceful operations on workers is 90 seconds Aug 24 09:45:25.161204 dv-cinder-854272-2-smb devstack@keystone.service[81523]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 09:45:25.161204 dv-cinder-854272-2-smb devstack@keystone.service[81523]: *** Operational MODE: preforking *** Aug 24 09:45:25.161494 dv-cinder-854272-2-smb devstack@keystone.service[81523]: *** uWSGI is running in multiple interpreter mode *** Aug 24 09:45:25.161494 dv-cinder-854272-2-smb devstack@keystone.service[81523]: spawned uWSGI master process (pid: 81523) Aug 24 09:45:25.161706 dv-cinder-854272-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 09:45:25.162760 dv-cinder-854272-2-smb devstack@keystone.service[81523]: spawned uWSGI worker 1 (pid: 81536, cores: 1) Aug 24 09:45:25.163131 dv-cinder-854272-2-smb devstack@keystone.service[81523]: spawned uWSGI worker 2 (pid: 81537, cores: 1) Aug 24 09:45:25.163291 dv-cinder-854272-2-smb devstack@keystone.service[81523]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 09:45:29.480163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:45:29.480163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: from cryptography.utils import int_from_bytes Aug 24 09:45:29.480953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:45:29.480953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: from cryptography.utils import int_from_bytes Aug 24 09:45:29.481359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:45:29.481359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: from cryptography.utils import int_from_bytes Aug 24 09:45:29.481474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:45:29.481474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: from cryptography.utils import int_from_bytes Aug 24 09:45:29.530175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:45:29.530384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:45:29.530469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:45:29.530550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:45:29.530615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] command line args: [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:45:29.530678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] command line args: [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:45:29.530815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:45:29.530897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:45:29.530960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ================================================================================ {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:45:29.531029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ================================================================================ {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:45:29.531203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] admin_token = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] admin_token = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] config_dir = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] config_dir = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] config_source = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.531880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] config_source = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] debug = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] debug = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.532908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_config_append = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_config_append = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.533974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_dir = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_dir = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_file = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_file = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.534947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.535971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.536954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.537082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.537161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.537320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.537446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.537610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.537966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] publish_errors = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] publish_errors = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.538935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] standard_threads = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] standard_threads = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.539936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] use_journal = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] use_journal = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] use_json = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] use_json = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] use_stderr = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] use_stderr = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] use_syslog = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.540933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] use_syslog = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.541055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.541136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:45:29.541208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.541276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.541452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.541574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.541687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.541781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.541954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.542856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.543876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.544813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.545993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.546959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.547907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.548910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.549888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.550935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.551938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.552920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.553918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.554994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.555885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.556891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.557968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.558956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.559974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.560972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.561995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.562969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.563917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.564897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.external = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.external = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.565904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.password = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] auth.token = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.password = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.566944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] auth.token = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.567998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.568997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.569937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.570971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.571877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.572919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.573966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.574984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.575161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.575276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.575412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.575535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.575645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.575754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.576927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.577924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.578933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.579980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.580989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.581986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.582983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.583896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.584998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.585907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.586940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.587903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.588989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.589965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.590968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.591950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.592975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.593904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.594924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.595899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.596892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.597899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] role.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] role.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] role.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.598964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] role.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.599996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.600989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.601990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.602946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.603920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.604983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.605974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.606946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.607078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.607196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.607292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.607385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.607918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.608988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.609936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.610040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.610134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.610226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.610319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.611932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.connection = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.connection = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.612952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.613924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.614016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.614117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.614447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.614645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.614822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.614822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.615918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.616019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.616019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:45:29.616193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.616285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:45:29.616391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:45:29.645654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.645849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.646090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.646293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.646517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.646747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.654530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.655253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.682825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.683123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.683324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.683552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.737602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.737858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.786843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.787015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.787015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.787273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.946952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.946952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.947363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.947491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.947648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.947772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.947852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.947950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.948114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.948330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.948546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.948760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.973234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.973431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.973572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.973658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.973826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.973931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.974862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.986246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.986463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.999420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.999591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.999733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.999818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.999881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:29.999965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81537) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.000798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81536) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:45:30.018526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.018702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.018858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:45:30.018945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:45:30.019040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.019152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.019273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:45:30.019350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:45:30.019556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.019680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.019798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.019878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.020324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.020461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.020543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.020606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.029942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.030854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.037977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.038125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.040901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.041049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.041174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.041352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.041444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.041615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.041703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.041901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.041989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.042983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.043188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.043390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.043472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.043670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.043754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.043942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.066391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.066811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.067893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.068177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.068302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.068579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.072886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.073172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.073317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.073458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.073540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.073787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.080792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.081076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.081460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.081755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.085201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.085490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.085775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.085881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.086061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.086975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.087201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.087297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.087459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.087727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.105137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.105404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.105531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.105699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.109656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.109915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.113052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.113350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.113460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.113681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.117587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.117938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.120726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.121090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.124244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.124244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.124478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.124564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.124711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.124794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.124915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.125084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.125178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.125400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.125529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.125753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.141513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.141818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.142112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.142202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.142386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.142476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.142687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.143158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.149372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.150296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.150904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.151210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.151856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.152114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.153840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.154125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.154424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.154907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.155099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.155248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.155353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.155657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.156053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.156339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.167334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.167632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.168004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.168412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.168705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.168830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.168966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.169059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.169252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.169364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.169583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.169890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.170190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.170498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.185382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.186898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.188426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.190328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.191654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.193450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.193874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.195090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.195439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.195723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.196017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.196651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.196940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.197312 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.202932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.204461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.204716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.206402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.207644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.207950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.208652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.208652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.209581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.209898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.210236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.210524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.216532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.216843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.217133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.219156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.219422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.219712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.225513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81537) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.225801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.226109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.226359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.226602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.226883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.227191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.227459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.227549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81536) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:45:30.227774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.228936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.229131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.229222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.229393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81537) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.229485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.229722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.230010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.230309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.230581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.230884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.231183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81536) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:45:30.267012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638a6c5f9c0 pid: 81536 (default app) Aug 24 09:45:30.270142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638a6c5f9c0 pid: 81537 (default app) Aug 24 09:45:30.270499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c6e18-840f-4815-a492-6820c666a4bc None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:30.270798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c6e18-840f-4815-a492-6820c666a4bc None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:30.271094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c6e18-840f-4815-a492-6820c666a4bc None None] PATH_INFO: `/v3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:30.275357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Aug 24 09:45:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:36.934269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.934825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.934825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.939134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:36.946499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.946924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.947036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:37.016750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: INFO dbcounter [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] Registered counter for database keystone Aug 24 09:45:37.036623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG oslo_db.sqlalchemy.engines [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:45:37.044114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writer thread running {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:45:37.234038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG passlib.handlers.bcrypt [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81536) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:45:37.234502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG passlib.handlers.bcrypt [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81536) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:45:37.290859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:37.292523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:37.430696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 09:45:37.886214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:37.955229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: INFO dbcounter [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] Registered counter for database keystone Aug 24 09:45:37.977915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG oslo_db.sqlalchemy.engines [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:45:37.985903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writer thread running {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:45:38.109174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725942-daee-42f4-a5c7-6a07fab6dfbc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:38.115669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.116369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.116680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.117180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.129388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.182190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:45:38.182440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d878e4e-0209-44e1-b800-b166561feed5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.194357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Aug 24 09:45:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:45:38.201147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:38.217945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f975-eb03-427e-8e86-2ebc1970d0f0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:38.223518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.224664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.224946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.225215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] PATH_INFO: `/v3/projects/0090fa1c947541c19958fa29c1afd1ff` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.226968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0090fa1c947541c19958fa29c1afd1ff)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.279245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:45:38.279591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb80d-85df-41d5-b61a-3f6749f368e2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.284317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Aug 24 09:45:38 2022] GET /identity/v3/projects/0090fa1c947541c19958fa29c1afd1ff => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:40.186655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267422-0580-483d-b194-d39d5ea539df None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.187332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267422-0580-483d-b194-d39d5ea539df None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.187332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267422-0580-483d-b194-d39d5ea539df None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.191528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:40.197319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.197759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.197849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.220113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:40.221655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.230604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 09:45:40.492579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267422-0580-483d-b194-d39d5ea539df None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.505735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267422-0580-483d-b194-d39d5ea539df None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.510408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3caba-8216-44cb-bfbe-1a1336509303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.511009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3caba-8216-44cb-bfbe-1a1336509303 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.511315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3caba-8216-44cb-bfbe-1a1336509303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.511589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3caba-8216-44cb-bfbe-1a1336509303 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.519473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3caba-8216-44cb-bfbe-1a1336509303 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.521358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3caba-8216-44cb-bfbe-1a1336509303 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.530120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Aug 24 09:45:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:45:40.536741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.546596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca0842-3d71-49a8-9b8d-2ac5308e4812 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.552588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07114b-2e2d-4897-8307-4f56ecf0ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.553232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07114b-2e2d-4897-8307-4f56ecf0ff35 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.553515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07114b-2e2d-4897-8307-4f56ecf0ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.553785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07114b-2e2d-4897-8307-4f56ecf0ff35 admin admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.555296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07114b-2e2d-4897-8307-4f56ecf0ff35 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.557192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07114b-2e2d-4897-8307-4f56ecf0ff35 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.558937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Aug 24 09:45:40 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:42.555586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8cd0e-04f9-420f-bb42-81fc8a7b7cf7 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.556111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8cd0e-04f9-420f-bb42-81fc8a7b7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.556111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8cd0e-04f9-420f-bb42-81fc8a7b7cf7 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.557387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:42.562782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.563251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.563585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.567947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f8e7-18d6-4706-8a9c-5e1e978d77b1 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.568234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f8e7-18d6-4706-8a9c-5e1e978d77b1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.568508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7f8e7-18d6-4706-8a9c-5e1e978d77b1 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.569728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:42.574893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.575223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.575505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.583580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:42.584811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.619799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG passlib.handlers.bcrypt [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81537) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:45:42.620240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG passlib.handlers.bcrypt [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81537) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:45:42.665937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:42.667546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.668790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:42.775039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:45:42.932606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.958282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.042003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.042727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72cf6b-d76e-4d35-abc3-b66f769f827f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.079370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.080008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.080288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.080560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.092779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:43.101669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:43.102608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:45:43.103465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:45:43.109167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.147343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab6b53-d9ee-4816-a9c8-a43e6371ba0b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.149904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.184929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.185713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.185993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.186261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.196229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.215028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658e4a-d585-4788-b06f-15fcec747e79 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.252339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.252958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.253265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.253549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.254234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:43.254536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.255979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.258603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.260165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.268834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:43.274767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.361098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:45:43.367388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.371140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.380539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4dd52-f354-4cce-b680-af0c719522b9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.416087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.416732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.417067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.417345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.418511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.420041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.421828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:43.427552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.442964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.471264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9efcd4-4630-4f2e-b4fa-e75dd93353b9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.506249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.507152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.507430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.507690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.527071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.528567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.536913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3279cc-1663-4104-8f1a-b1c961a37b9b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:45:43.546938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:43.547920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:45:43.548706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:45:43.548706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:45:43.548706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:43.548706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:43.554721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.575644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.576287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.576564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.576820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.577987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.580055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.581931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:43.587814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.612385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.661235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f1f8a-c33f-483f-addc-52120d9c26c7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.678104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.695855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.696414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.696695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.696970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.697629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:43.697932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.698023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a7d9-cb96-4d55-9097-f122bf84bec5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.699379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ad8c-6699-4af0-9b4a-acba86a2fb59 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.718681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:43.734222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.734861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.735173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.735446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.736199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.domain.id=default, user.id=7d891070d24d41cb9c32f1d43f5c805b) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:43.736506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.738283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e632b-99bf-452b-8e52-937a8f7e9753 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.746786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/role_assignments?user.id=7d891070d24d41cb9c32f1d43f5c805b&scope.domain.id=default&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:45.886014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28f3c-26cd-471f-a6e6-34dc6cf63eb4 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.887071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28f3c-26cd-471f-a6e6-34dc6cf63eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.887557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28f3c-26cd-471f-a6e6-34dc6cf63eb4 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.889123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:45.900395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b866-ac07-4a51-b6b2-a330bb1790d3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.900898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b866-ac07-4a51-b6b2-a330bb1790d3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.901392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b866-ac07-4a51-b6b2-a330bb1790d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.927321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9ec6b866-ac07-4a51-b6b2-a330bb1790d3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:45.928536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9ec6b866-ac07-4a51-b6b2-a330bb1790d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.022179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:46.355106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241857-af39-4cc0-91f2-6b07552666e5 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.355762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241857-af39-4cc0-91f2-6b07552666e5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.356231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241857-af39-4cc0-91f2-6b07552666e5 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.357767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 12/24] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:46.368253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cd3a-3c30-48fe-ab69-3427a236c130 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.368827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cd3a-3c30-48fe-ab69-3427a236c130 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.369390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cd3a-3c30-48fe-ab69-3427a236c130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.389527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94241857-af39-4cc0-91f2-6b07552666e5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.391876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6524cd3a-3c30-48fe-ab69-3427a236c130 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:46.393127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6524cd3a-3c30-48fe-ab69-3427a236c130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.526810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 13/25] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:46.533826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5198e-61ee-4bf5-a9ae-519b1bed400f None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.534117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5198e-61ee-4bf5-a9ae-519b1bed400f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.534735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5198e-61ee-4bf5-a9ae-519b1bed400f None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.536142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 14/26] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:46.546695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a82aa-d61b-44f2-a1bc-052f64a19f99 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.546982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a82aa-d61b-44f2-a1bc-052f64a19f99 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.551417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a82aa-d61b-44f2-a1bc-052f64a19f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.563677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:46.594185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2c6a82aa-d61b-44f2-a1bc-052f64a19f99 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:46.595501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2c6a82aa-d61b-44f2-a1bc-052f64a19f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.626185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94241857-af39-4cc0-91f2-6b07552666e5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.652777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:46.699698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.700347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.700625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.700897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.735748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:46.742141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:46.742988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:46.743762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:46.749995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 13/27] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:46.756042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.762315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:45:46.889868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbdc1e-05c9-47bf-a65d-814da0f7b20c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.942650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.943350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.943618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.943716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344468db-68ea-456f-b45e-e0578616e8fd None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.944122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.944198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344468db-68ea-456f-b45e-e0578616e8fd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.944198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344468db-68ea-456f-b45e-e0578616e8fd None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.944569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:46.944871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.945768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 16/29] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:46.946297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.960828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.961164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.961395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.963999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 14/30] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:46.969746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.996798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:46.997995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.039528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.119481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 17/31] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:45:47.120317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.122554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcfd80-2351-46a0-a37f-6350d7a4bba0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.211836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.212564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.212846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.213222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.216488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.217440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.219020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.220607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 15/32] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:47.221849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.261471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e65c-1722-4ee4-8a9f-3e5aec5736f9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.301440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.302456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.302929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.303420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.304482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.306431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.418812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02680cd3-884b-45c9-95ca-6548c5b23528 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.428169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.459135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.459839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.460117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.460383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.471950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.479548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.479729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 18/33] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/roles => generated 219 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:47.479729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-c2a8693f-6db7-4aa5-8b0e-b9f78f67090b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:45:47.506311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:47.507265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:45:47.508079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:45:47.508079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:45:47.508079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:47.508079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 16/34] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:47.509009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de274a51-e257-462b-9eb9-d5a30d9de048 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.509195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de274a51-e257-462b-9eb9-d5a30d9de048 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.511885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de274a51-e257-462b-9eb9-d5a30d9de048 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.511885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 17/35] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:47.511885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de274a51-e257-462b-9eb9-d5a30d9de048 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.617471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07afc-797d-487f-a77f-376572c94619 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.651987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.656770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de274a51-e257-462b-9eb9-d5a30d9de048 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.676988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.677802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.678084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.678358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.679846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.681556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.683222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 19/36] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:47.688116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.703456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84145a-a83f-411d-a34e-2b60a7852bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.704115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84145a-a83f-411d-a34e-2b60a7852bfe None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.704400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84145a-a83f-411d-a34e-2b60a7852bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.704669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84145a-a83f-411d-a34e-2b60a7852bfe None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.705390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84145a-a83f-411d-a34e-2b60a7852bfe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.706896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84145a-a83f-411d-a34e-2b60a7852bfe None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.806300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49aa3b-344e-4ca2-b6ba-dc989db41fe0 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.834308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:47.835939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852676-155f-43ec-a9db-0113da553146 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.836422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852676-155f-43ec-a9db-0113da553146 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.836735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852676-155f-43ec-a9db-0113da553146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.842521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.843202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.843490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.843912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.844578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:47.844889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.846408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.857757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c8852676-155f-43ec-a9db-0113da553146 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:47.859643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c8852676-155f-43ec-a9db-0113da553146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.868341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:47.869280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.882548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.938848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.947492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 19/39] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:47.960591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64da06a-f4e6-4d92-b507-12083dfa4339 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.960990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64da06a-f4e6-4d92-b507-12083dfa4339 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.961185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64da06a-f4e6-4d92-b507-12083dfa4339 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.970972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 20/40] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:47 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:47.970972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64da06a-f4e6-4d92-b507-12083dfa4339 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.022789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138c9-8751-4568-9b28-33e8b6130174 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.067654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a6643-f6cd-42e1-955c-3127bbf82a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.068868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a6643-f6cd-42e1-955c-3127bbf82a7a None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.069153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a6643-f6cd-42e1-955c-3127bbf82a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.069446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a6643-f6cd-42e1-955c-3127bbf82a7a None admin] PATH_INFO: `/v3/domains/default/users/7d891070d24d41cb9c32f1d43f5c805b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.071567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a6643-f6cd-42e1-955c-3127bbf82a7a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7d891070d24d41cb9c32f1d43f5c805b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.073046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a6643-f6cd-42e1-955c-3127bbf82a7a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.094474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 21/41] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Aug 24 09:45:47 2022] PUT /identity/v3/domains/default/users/7d891070d24d41cb9c32f1d43f5c805b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:48.095997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.096407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.096896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.116821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64da06a-f4e6-4d92-b507-12083dfa4339 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.119235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:48.121207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:48.166200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.167164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.167620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.168092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.169266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.172158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.202675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:48.215594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 21/42] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/projects => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:48.241161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.342515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 22/43] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:48.375986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf8137-1ec9-4acb-8047-684d7505850c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.412498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.413135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.413420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.413695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.414383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.415832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.433094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 22/44] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/roles => generated 223 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:48.628992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.676886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:48.742769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7e194-f9d1-4c6f-9dbe-faba5120834b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.779581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb250-5769-4e36-9ede-f2dac8dbb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.780253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb250-5769-4e36-9ede-f2dac8dbb5cf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.780538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb250-5769-4e36-9ede-f2dac8dbb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.780814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb250-5769-4e36-9ede-f2dac8dbb5cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.782017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bb250-5769-4e36-9ede-f2dac8dbb5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.783725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bb250-5769-4e36-9ede-f2dac8dbb5cf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.785370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 23/45] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:48.791131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.859030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:48.902344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d7674-2c83-4788-a5c6-25ff5d5ea033 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.941314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97d8a1-b19c-4c3d-a758-3785264b0457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.941924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97d8a1-b19c-4c3d-a758-3785264b0457 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.942203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97d8a1-b19c-4c3d-a758-3785264b0457 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.942471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97d8a1-b19c-4c3d-a758-3785264b0457 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.943150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97d8a1-b19c-4c3d-a758-3785264b0457 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.944940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97d8a1-b19c-4c3d-a758-3785264b0457 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.972409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:50.127345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f788e-d7f5-42ac-9e2b-c872047f81da None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.127870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f788e-d7f5-42ac-9e2b-c872047f81da None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.127973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f788e-d7f5-42ac-9e2b-c872047f81da None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.129858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:50.135792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.136548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.136692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.161630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:50.162841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:50.237379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:50.509161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f788e-d7f5-42ac-9e2b-c872047f81da None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.620026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f788e-d7f5-42ac-9e2b-c872047f81da None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.632014 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:50.658591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.659259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.659545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.659823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.670274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:50.675181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:50.676015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:45:50.676963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:50.682207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.727033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:50.786617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba72045-80ef-461d-a02d-ea33ae2814bc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.822053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.822675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.822959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.823272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.823949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:50.824252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.825650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef4b8-458b-453b-b4bc-7a21c4f5bdf6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.835187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 25/50] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:50.840842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.918864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d222a8-6b45-43f3-8865-73cb5fad007f None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.919156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d222a8-6b45-43f3-8865-73cb5fad007f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.919461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d222a8-6b45-43f3-8865-73cb5fad007f None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.920839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 26/51] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:50.926160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.926449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.926709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.946873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:50.948137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:50.949508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd814db-c870-4733-a3b9-62fd8c866889 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.985194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.986007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.986293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.986571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.987742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.989248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.991071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 26/52] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:50.996456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:51.028360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 27/53] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:45:51.043659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:51.111990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d52fc-a413-4e36-b2d1-578aedd02ad2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:51.162196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:51.162864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:51.163203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:51.163493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:51.164684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:51.166164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:51.167789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 27/54] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:51.174017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:51.210440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:51.307013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:51.391639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a9a9-7469-48c2-8caa-5376331d7d5f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:51.423795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf277-cd23-4cf5-8168-0adfb6323d92 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:51.426704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:51.427384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:51.427662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:51.427932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:51.428662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.domain.id=default, user.id=7d891070d24d41cb9c32f1d43f5c805b) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:51.428975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:51.430442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:51.431218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:51.440968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 28/55] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Aug 24 09:45:51 2022] GET /identity/v3/role_assignments?user.id=7d891070d24d41cb9c32f1d43f5c805b&scope.domain.id=default&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 530 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:51.463178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aaf60-0471-4f6f-add8-d81f0738f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:51.463887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aaf60-0471-4f6f-add8-d81f0738f562 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:51.464174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aaf60-0471-4f6f-add8-d81f0738f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:51.464453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aaf60-0471-4f6f-add8-d81f0738f562 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:51.465722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aaf60-0471-4f6f-add8-d81f0738f562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:51.467348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aaf60-0471-4f6f-add8-d81f0738f562 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:51.469105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 28/56] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:51.475560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:51.586688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:51.591379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c118f00-ebca-4256-908e-bb705b15dd02 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:51.628185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b705ce0-b489-4134-8570-1840c8789032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:51.628816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705ce0-b489-4134-8570-1840c8789032 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:51.629113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705ce0-b489-4134-8570-1840c8789032 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:51.629371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b705ce0-b489-4134-8570-1840c8789032 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:51.630024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b705ce0-b489-4134-8570-1840c8789032 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:51.631564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b705ce0-b489-4134-8570-1840c8789032 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:51.662232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 29/57] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Aug 24 09:45:51 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:53.575614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8a80-f00f-4d35-a86d-ad012eaad48d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.576495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8a80-f00f-4d35-a86d-ad012eaad48d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.576591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8a80-f00f-4d35-a86d-ad012eaad48d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.578163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 29/58] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:53.583861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.584282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.584413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.609634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:53.610932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.683737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 30/59] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:53.951188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8a80-f00f-4d35-a86d-ad012eaad48d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.078300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8a80-f00f-4d35-a86d-ad012eaad48d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.113476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a1b2-3df6-497a-b822-783ceeee52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.114110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a1b2-3df6-497a-b822-783ceeee52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.114395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a1b2-3df6-497a-b822-783ceeee52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.114668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a1b2-3df6-497a-b822-783ceeee52d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.115903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a1b2-3df6-497a-b822-783ceeee52d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.117456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a1b2-3df6-497a-b822-783ceeee52d9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.119101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 30/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:54.125369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.218421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:54.252191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eeac9-2183-4605-a2fe-53ed19fd60f7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.299716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4279bc-abbe-4381-8317-4cacfba5accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.300330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4279bc-abbe-4381-8317-4cacfba5accc None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.300611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4279bc-abbe-4381-8317-4cacfba5accc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.300885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4279bc-abbe-4381-8317-4cacfba5accc None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.301541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4279bc-abbe-4381-8317-4cacfba5accc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.303024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4279bc-abbe-4381-8317-4cacfba5accc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.332333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 31/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:45:54 2022] POST /identity/v3/users => generated 275 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:57.439615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01120a86-5a43-4e2d-92dd-d1f386a4de1b None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.440121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01120a86-5a43-4e2d-92dd-d1f386a4de1b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.440192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01120a86-5a43-4e2d-92dd-d1f386a4de1b None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.441526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 31/62] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:57.457603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2c0c-5ef6-4efe-911b-c882c3dc7b54 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.458499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2c0c-5ef6-4efe-911b-c882c3dc7b54 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.458916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e2c0c-5ef6-4efe-911b-c882c3dc7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.479618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-8c7e2c0c-5ef6-4efe-911b-c882c3dc7b54 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:57.481070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8c7e2c0c-5ef6-4efe-911b-c882c3dc7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:57.577980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 32/63] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:57.640102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435f855-2600-4db2-9a64-83f8407f2c47 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.640102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435f855-2600-4db2-9a64-83f8407f2c47 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.640102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435f855-2600-4db2-9a64-83f8407f2c47 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.640102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 32/64] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:57.646070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.646364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.646698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.693642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:57.694852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:57.713089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee931-f708-42d8-b14f-86626c0ced0c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.713694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee931-f708-42d8-b14f-86626c0ced0c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.714169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee931-f708-42d8-b14f-86626c0ced0c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.715770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 33/65] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:57.729231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752752c2-5b07-4e14-835e-de69090922f2 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.729528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752752c2-5b07-4e14-835e-de69090922f2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.729795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752752c2-5b07-4e14-835e-de69090922f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.763204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-752752c2-5b07-4e14-835e-de69090922f2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:57.764439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-752752c2-5b07-4e14-835e-de69090922f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:57.807790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:57.839420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:57.849755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 33/66] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:45:57.869966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 34/67] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:57.964748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.009728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2c6f-2a4c-424b-8e0b-e42a5c4e4574 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.009728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2c6f-2a4c-424b-8e0b-e42a5c4e4574 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.009728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2c6f-2a4c-424b-8e0b-e42a5c4e4574 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.009728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 35/68] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:58.017734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.018025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.018298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.055017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:58.056258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:58.099033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387f7f-9ea9-4d07-9e6d-c773ccd8a238 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.135773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.136425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.136705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.136985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.163445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:58.168307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:58.169178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:58.169918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:58.170690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.192134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 36/70] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:45:58.198115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.243339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.300467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16da2a9-966c-45fd-a95d-b233d71602ec None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.314276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82c5ec-3c3f-4442-8ece-026381f8ccf1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.315911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.340371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c897-67a5-4101-aa72-143ed76fb065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.341011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c897-67a5-4101-aa72-143ed76fb065 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.341292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c897-67a5-4101-aa72-143ed76fb065 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.341565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c897-67a5-4101-aa72-143ed76fb065 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.352636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c897-67a5-4101-aa72-143ed76fb065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-c5a1c897-67a5-4101-aa72-143ed76fb065 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:58.357907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:58.358816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:58.360026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:58.360658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7099bd-bdb8-47b9-8bc4-6c060b077c88 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.360955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7099bd-bdb8-47b9-8bc4-6c060b077c88 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.361105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7099bd-bdb8-47b9-8bc4-6c060b077c88 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.362332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 36/72] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:45:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:58.366875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7099bd-bdb8-47b9-8bc4-6c060b077c88 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.370706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.371350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.371633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.371907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.373075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:58.373075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.374302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.386835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 37/73] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:58.392405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.484005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7099bd-bdb8-47b9-8bc4-6c060b077c88 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.501590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0a06-94a9-492e-9c6d-90946a640977 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.502034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.521449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ae90b-535b-4e96-bd02-1dac263a3dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.522085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae90b-535b-4e96-bd02-1dac263a3dbc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.522363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae90b-535b-4e96-bd02-1dac263a3dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.522632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae90b-535b-4e96-bd02-1dac263a3dbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.533245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae90b-535b-4e96-bd02-1dac263a3dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:58.535684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.536294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.536572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.536842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.537512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:58.537816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-b61ae90b-535b-4e96-bd02-1dac263a3dbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:58.537975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:58.538792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:58.539573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 37/74] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:58.540198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.540263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.540545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.540818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.548409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 38/75] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:58.549223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.562068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:58.563318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:58.584112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.635323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 38/76] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:58.636944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.666430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7da9-16dd-4ece-bc77-786b9fb9d299 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.705966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.706610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.706900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.707212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.708434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.709897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.716153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 39/77] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:58.716153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.760483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc3576-81a7-4bf9-a4da-697bad61942e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.768458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.804318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.804963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.805250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.805528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.816884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:45:58.821603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:45:58.822463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:45:58.823236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 39/78] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:45:58.826190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.828580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.834945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6e3e8-a54a-45cf-9787-616b4e480df3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.879246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.879870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.880156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.880440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.881123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:58.881434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.882829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.895231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 40/79] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:58.895231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.946022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c7f2-9e56-4a80-b6f8-94c982fd3be4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.982186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.982864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.983309 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.983436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.997598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e1677-3848-42f7-9b8b-bde58f7aab21 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.998737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.000498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.002199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 40/80] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:59.002977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.029729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.033688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.034305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.034583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.034853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.061237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.114437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.116013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.120742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614995a-1fcd-488c-9256-0c8d6125eb3c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.158205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.158935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.159250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.159515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.160202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:59.160508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.165674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.179037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 41/81] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:59.179037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.235156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 41/82] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:59.235745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.274126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.290572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119446a-dc70-4cd5-b92b-a146109615fe None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.300314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.333755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.334393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.334674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.334948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.336596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.338066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.345074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 42/83] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:59.345074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.354858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0a67-fa03-43bc-9660-4d40f70f1429 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.393717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.394362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.394640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.394910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.396131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.397609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.399212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 42/84] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:59.399975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.452559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35733e1-5445-48c6-9b6f-3400f8abd074 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.489179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.489827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.490071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.490349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.508915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91def54-4004-463d-a09e-bdd8dfd9bee5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.514407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.540517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.553365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.553938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.554217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.554724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.555768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.557279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.558888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 43/85] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:59.559584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.559687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.561151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.666959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 43/86] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:59.667873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.668014 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90507de-32ab-423e-8556-34399c722ec9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.705159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.705807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.706094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.706482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.707709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.709187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.710934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 44/87] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:59.711747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.728907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.785686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2aa7-f94a-4526-aa6f-62328b3b4822 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.786347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.825488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.826129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.826416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.826898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.837956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daccb7-ae58-4ee1-a55c-905635f46536 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.872879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.873541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.873822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.874105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.874922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.876447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.903356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.905290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.919392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 45/88] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:45:59 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:59.919392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.988454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.037777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c617b9-a15c-48c6-aeeb-76824d467df5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.052866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 44/89] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:00.052866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.065977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.099904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2609-747a-4374-b991-514801f084c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.100471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2609-747a-4374-b991-514801f084c6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.100758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2609-747a-4374-b991-514801f084c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.102422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2609-747a-4374-b991-514801f084c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.191684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c0ee9-b463-4e61-8035-61eb021fd6f4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.200941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b2609-747a-4374-b991-514801f084c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.200941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b2609-747a-4374-b991-514801f084c6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.243549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.244218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.244704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.244961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.246465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.248014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.250119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 45/90] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:00.250650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.278801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.342311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 46/91] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:00.344556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2609-747a-4374-b991-514801f084c6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.369114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.391451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee641-736b-4597-91db-7b43df65d55a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.428131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.428988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.429410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.429885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.430764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=c42940a322704827857570b326a06b8b, user.id=7d891070d24d41cb9c32f1d43f5c805b) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:00.431246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.433152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.447223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 46/92] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/role_assignments?user.id=7d891070d24d41cb9c32f1d43f5c805b&scope.project.id=c42940a322704827857570b326a06b8b&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:00.448773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.483234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2609-747a-4374-b991-514801f084c6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.533799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.534808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.535359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.535845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.538135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.542108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.542108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 47/93] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:00.542670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.637058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.652085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.672797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200f04-1513-46a4-9fc1-fad643ab04db None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.685355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63cdba-701e-4699-b40d-f933fbc2ec65 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.712659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.713323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.713608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.713883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] PATH_INFO: `/v3/projects/a81613dabbcd40b595aed83f8fd80a99` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.715185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a81613dabbcd40b595aed83f8fd80a99)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.716676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.719223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 48/94] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/projects/a81613dabbcd40b595aed83f8fd80a99 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:00.720175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.779579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.780296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.780614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.780888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.781737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] RBAC: Adding query filter params (role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=c42940a322704827857570b326a06b8b, user.id=4e466019f8ec487cb0208e3023b4adc5) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:00.781945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.783450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.806274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 47/95] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/role_assignments?user.id=4e466019f8ec487cb0208e3023b4adc5&scope.project.id=c42940a322704827857570b326a06b8b&role.id=e748222847a44424b09a5d0be46f4c05 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:00.806274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.844071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029103-1f3f-4d76-b263-025740ec62c0 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.890521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.891516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.892047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.892537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.895095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, scope.project.id=c42940a322704827857570b326a06b8b, user.id=4e466019f8ec487cb0208e3023b4adc5) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:00.895675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.897371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079257-1598-47e6-b17d-0a3329d53dff None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.913689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 49/96] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/role_assignments?user.id=4e466019f8ec487cb0208e3023b4adc5&scope.project.id=c42940a322704827857570b326a06b8b&role.id=67f08f193c9646cb847747a851778af2 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:01.027474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1d3a-3ca7-4d72-89fb-917b6146246e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.085287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.085915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.086197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.086462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.087233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, scope.project.id=a81613dabbcd40b595aed83f8fd80a99, user.id=4e466019f8ec487cb0208e3023b4adc5) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:01.087544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.089008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c0c84-0236-488a-85a5-8f223d3dc21e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.099951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 48/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:00 2022] GET /identity/v3/role_assignments?user.id=4e466019f8ec487cb0208e3023b4adc5&scope.project.id=a81613dabbcd40b595aed83f8fd80a99&role.id=67f08f193c9646cb847747a851778af2 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:02.466288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da420-2741-467c-bec0-20d32c001ce2 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.467340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da420-2741-467c-bec0-20d32c001ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.468256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1da420-2741-467c-bec0-20d32c001ce2 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.470167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 50/98] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:02.476563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb3614-f903-4413-baca-412ef3ad6cc6 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.477519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb3614-f903-4413-baca-412ef3ad6cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.477993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb3614-f903-4413-baca-412ef3ad6cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.500560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-ffdb3614-f903-4413-baca-412ef3ad6cc6 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:02.502107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ffdb3614-f903-4413-baca-412ef3ad6cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.515980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:02.598908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 49/99] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:02.811271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d724-b34e-45b6-ac8b-8c22033c2ccb None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.811692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d724-b34e-45b6-ac8b-8c22033c2ccb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.811834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2d724-b34e-45b6-ac8b-8c22033c2ccb None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.813176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 51/100] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:02.821095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dcdc-6fb2-441e-ad6d-ce2e756dd645 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.821384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dcdc-6fb2-441e-ad6d-ce2e756dd645 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.821663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8dcdc-6fb2-441e-ad6d-ce2e756dd645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.848446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-35f8dcdc-6fb2-441e-ad6d-ce2e756dd645 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:02.849688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-35f8dcdc-6fb2-441e-ad6d-ce2e756dd645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.940086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 50/101] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:03.094878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2d724-b34e-45b6-ac8b-8c22033c2ccb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.119907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.149579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27745d5-6a7c-4e2f-94f0-78922715e598 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.149873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27745d5-6a7c-4e2f-94f0-78922715e598 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.150140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27745d5-6a7c-4e2f-94f0-78922715e598 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.151551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 51/102] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:03.164650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.164939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.165227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.198394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:03.199936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:03.296404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2d724-b34e-45b6-ac8b-8c22033c2ccb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.346816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.347417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.347798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.348074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.349009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 52/103] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:03.349886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.365061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.371832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:03.378539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:03.379443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:03.380206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 52/104] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:03.388186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.478509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.505454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226547b-b39f-41b9-9f93-f4dbc6496373 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.542377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.543264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.543760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.544165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.544976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:03.545579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.547160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.556366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 53/105] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:03.562398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c468-5fa0-4110-80bd-72bfc519dbc2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.565596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.621147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.621707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.622038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.622320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.624111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.625845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.627520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 53/106] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:03.635358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.771486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.817065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f6d7-3205-4af2-b556-c83bc902a043 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.838599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f282d-6861-4fb4-9a47-84fb6688f440 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.870354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.871028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.871393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.871619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] PATH_INFO: `/v3/users/d8e22d8515484ff1a1e66cd514ef1b87` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.888161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.900161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] RBAC: Authorizing `identity:get_user(user_id=d8e22d8515484ff1a1e66cd514ef1b87)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.901673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.903443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 54/107] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/users/d8e22d8515484ff1a1e66cd514ef1b87 => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:03.907383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.913390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.914026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.914311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.914641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.915345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.917900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.955471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 54/108] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:46:03 2022] POST /identity/v3/projects => generated 302 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:03.956847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.049432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752e90-1fcd-4b4e-8780-0f8216a5ac1e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.098131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dfa7d-6254-48c4-9d61-309e339e8589 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.126157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f1979-0c2a-4095-a243-90ac04f6f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.126800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1979-0c2a-4095-a243-90ac04f6f87a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.127111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1979-0c2a-4095-a243-90ac04f6f87a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.127394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1979-0c2a-4095-a243-90ac04f6f87a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.128125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.144808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f849c-71ad-4df0-958a-910d7821c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.145672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f849c-71ad-4df0-958a-910d7821c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.145964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f849c-71ad-4df0-958a-910d7821c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.146242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f849c-71ad-4df0-958a-910d7821c0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.160329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f1979-0c2a-4095-a243-90ac04f6f87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-7f5f1979-0c2a-4095-a243-90ac04f6f87a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:04.165540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:04.166530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:04.167292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:04.172620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 55/109] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:04.174106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef006-aedc-43d2-9b0e-c23d017f081c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.174402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef006-aedc-43d2-9b0e-c23d017f081c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.174706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef006-aedc-43d2-9b0e-c23d017f081c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.176560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 56/110] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:04.183471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.183780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.184018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.214744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:04.216027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.236852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f849c-71ad-4df0-958a-910d7821c0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.238417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f849c-71ad-4df0-958a-910d7821c0b5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.278594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.293042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 57/111] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:04.294375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.350600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 55/112] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:04.355972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ed0e-7a3d-4783-aa7c-5dcd1ae4d722 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.356264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ed0e-7a3d-4783-aa7c-5dcd1ae4d722 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.356545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ed0e-7a3d-4783-aa7c-5dcd1ae4d722 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.358119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 56/113] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:04.359941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56ed0e-7a3d-4783-aa7c-5dcd1ae4d722 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.400312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.427008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb18b5a-c95d-4fa4-9228-13c4f48fa8da None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.480589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.481682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.481972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.482578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.484275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:04.484596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.486500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3130-c4dd-43e2-a494-b50557503621 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.501083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 58/114] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:04.501959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56ed0e-7a3d-4783-aa7c-5dcd1ae4d722 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.502419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.502772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.503296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.526187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:04.527598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.554121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7c62-19b5-4430-a733-3cae0a5cd515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.555127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7c62-19b5-4430-a733-3cae0a5cd515 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.555484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7c62-19b5-4430-a733-3cae0a5cd515 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.555965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7c62-19b5-4430-a733-3cae0a5cd515 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.557967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd7c62-19b5-4430-a733-3cae0a5cd515 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.559811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd7c62-19b5-4430-a733-3cae0a5cd515 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.562702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 57/115] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:04.564182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3aa3-3429-4908-ab1c-228d867be706 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.564472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3aa3-3429-4908-ab1c-228d867be706 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.564803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3aa3-3429-4908-ab1c-228d867be706 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.566158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 58/116] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:04.566878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3aa3-3429-4908-ab1c-228d867be706 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.592771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.625902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 59/117] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:04.626774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.688175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.700268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc3aa3-3429-4908-ab1c-228d867be706 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.741539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b4bcf-9313-4099-8b8f-b54f64fd2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.742189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b4bcf-9313-4099-8b8f-b54f64fd2e32 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.742478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b4bcf-9313-4099-8b8f-b54f64fd2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.742749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b4bcf-9313-4099-8b8f-b54f64fd2e32 None admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.743969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b4bcf-9313-4099-8b8f-b54f64fd2e32 None admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.745525 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b4bcf-9313-4099-8b8f-b54f64fd2e32 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.747331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 59/118] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:04.748804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.749142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.749435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.770252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:04.771527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.776251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca61f-c88e-41c5-a715-c86813b06302 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.825126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.826450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.827031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.827579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.828811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] RBAC: Adding query filter params (role.id=30361c25f36a4cb1b5c001474c0f029d, scope.project.id=c42940a322704827857570b326a06b8b, user.id=d8e22d8515484ff1a1e66cd514ef1b87) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:04.829736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.831493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.840121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 60/119] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/role_assignments?user.id=d8e22d8515484ff1a1e66cd514ef1b87&scope.project.id=c42940a322704827857570b326a06b8b&role.id=30361c25f36a4cb1b5c001474c0f029d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:04.845453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.875303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 60/120] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:04.876967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.947818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.036595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.047405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd47a4-6ba5-4a7f-83e6-3e50cfd43532 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.091377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b00d2e-5d5a-48a4-93a3-614511c05a74 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.097560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.099317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.103695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.104222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.108671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:05.110379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:05.112382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 61/121] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:05.116215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.176478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.178565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.179773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.180260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.208141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:05.223799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:05.224705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:05.225434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:05.227755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 61/122] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:05.230536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.314275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca359653-fbf4-4496-a4da-01aef9325d68 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.369636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.370323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.370609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.370885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.372038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7d275-5b78-4c1d-9f9b-8900044ce13d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.375850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.386255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:05.392503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:05.393357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:05.394105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 62/123] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:05.394892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.423040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.424572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.425508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.425919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.427456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b/users/7d891070d24d41cb9c32f1d43f5c805b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.431029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42940a322704827857570b326a06b8b, user_id=7d891070d24d41cb9c32f1d43f5c805b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:05.434082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:05.452318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 62/124] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:05 2022] PUT /identity/v3/projects/c42940a322704827857570b326a06b8b/users/7d891070d24d41cb9c32f1d43f5c805b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:05.453608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.550527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756fb43-0396-4b8b-9b8f-6f2dc115d1cf None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.589425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.590150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.590419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.590703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.601070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768ee95-46df-4dc3-ac00-4201873f6279 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.603500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:05.608387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:05.609263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:05.610039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 63/125] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:05.610656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.653593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.654777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.656041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.656520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.657490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:05.657978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:05.659636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:05.673141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 63/126] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:05.680274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.714164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.719994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.751104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dbcee-ec2d-4878-b454-6fd5b0afb3a5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.804166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.804826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.805116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.805392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.806106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:05.806417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:05.808720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:05.820650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 64/127] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:05.821727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.893130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaba7-0bbb-41f2-be7a-4fa88ec5ae57 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.943501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7da-4103-4425-9429-cd5ac16830f8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:05.962602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.963267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.963544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.963815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.964507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:05.964813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:05.966241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:05.982970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:05.983888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.984091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.984343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.985933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:05.987513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:05.989236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 65/128] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:05.990199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:05.991884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 64/129] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:05.997680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.021530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:06.159441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:06.166095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a60bbe-34bc-4f27-914b-de45a19c152c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:06.207734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:06.208555 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.208988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.210009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.215081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:06.215081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:06.215081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 65/130] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:06.215710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.273773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5f56b-f314-46a9-b839-9ef1a7e5e926 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:06.330289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59708d-5ed5-4a77-89a9-a06edcc43ad3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:06.370356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:06.371204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.371574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.372058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.373976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:06.375820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:06.378553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 66/131] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:06 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:06.379655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.423231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:06.440841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:06.441824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.442572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.443368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.448232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:06.451475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:06.454509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 66/132] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:05 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:06.456135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.506113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c502-c780-48c3-a06b-7e5e59e9d01c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:06.546291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:06.548150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.548857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.552105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] PATH_INFO: `/v3/projects/a81613dabbcd40b595aed83f8fd80a99` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.555618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] RBAC: Authorizing `identity:get_project(project_id=a81613dabbcd40b595aed83f8fd80a99)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:06.557459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:06.564406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 67/133] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:06 2022] GET /identity/v3/projects/a81613dabbcd40b595aed83f8fd80a99 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:06.565507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.637760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:06.688827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545f7f6-fa90-4d86-a0bb-d20167d1fdcb None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:06.723880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:06.739427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18418241-03e2-454a-a0d2-d5b0e04ec9ab None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:06.750734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:06.751888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.752348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.752723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b/users/4e466019f8ec487cb0208e3023b4adc5/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.755657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42940a322704827857570b326a06b8b, user_id=4e466019f8ec487cb0208e3023b4adc5, role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:06.757484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:06.787076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 67/134] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:06 2022] PUT /identity/v3/projects/c42940a322704827857570b326a06b8b/users/4e466019f8ec487cb0208e3023b4adc5/roles/e748222847a44424b09a5d0be46f4c05 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:06.787076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.799308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270910-cf4d-4b35-acf4-7e0521989b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:06.800085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270910-cf4d-4b35-acf4-7e0521989b7d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.800368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270910-cf4d-4b35-acf4-7e0521989b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.800645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270910-cf4d-4b35-acf4-7e0521989b7d None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.803212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270910-cf4d-4b35-acf4-7e0521989b7d None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:06.807213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270910-cf4d-4b35-acf4-7e0521989b7d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:06.809477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 68/135] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:06 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:06.814078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf4de-ee2f-4e46-897d-e43e2c6e3877 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.814404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf4de-ee2f-4e46-897d-e43e2c6e3877 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.814686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf4de-ee2f-4e46-897d-e43e2c6e3877 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.819471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 69/136] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:06.821273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf4de-ee2f-4e46-897d-e43e2c6e3877 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:06.980919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749699fc-c3e2-4708-9c97-9af8b426d792 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:07.043881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3d87-dc20-468f-be42-2c3043e40e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:07.044592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3d87-dc20-468f-be42-2c3043e40e8a None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:07.044927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3d87-dc20-468f-be42-2c3043e40e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:07.045394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3d87-dc20-468f-be42-2c3043e40e8a None admin] PATH_INFO: `/v3/projects/a81613dabbcd40b595aed83f8fd80a99/users/4e466019f8ec487cb0208e3023b4adc5/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:07.048810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c3d87-dc20-468f-be42-2c3043e40e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=a81613dabbcd40b595aed83f8fd80a99, user_id=4e466019f8ec487cb0208e3023b4adc5, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:07.050336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c3d87-dc20-468f-be42-2c3043e40e8a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:07.063818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:07.064884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf4de-ee2f-4e46-897d-e43e2c6e3877 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:07.081487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 68/137] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:06 2022] PUT /identity/v3/projects/a81613dabbcd40b595aed83f8fd80a99/users/4e466019f8ec487cb0208e3023b4adc5/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:07.082566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0dfe-ecee-48df-b932-3bcbfd117e1b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:07.082860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0dfe-ecee-48df-b932-3bcbfd117e1b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:07.087313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0dfe-ecee-48df-b932-3bcbfd117e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:07.121984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c05a0dfe-ecee-48df-b932-3bcbfd117e1b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:07.125480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c05a0dfe-ecee-48df-b932-3bcbfd117e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:07.147670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:07.148407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:07.148700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:07.149115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b/users/4e466019f8ec487cb0208e3023b4adc5/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:07.156068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42940a322704827857570b326a06b8b, user_id=4e466019f8ec487cb0208e3023b4adc5, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:07.157581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:07.185537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 70/138] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:06 2022] PUT /identity/v3/projects/c42940a322704827857570b326a06b8b/users/4e466019f8ec487cb0208e3023b4adc5/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:07.242237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 69/139] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:07.553467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:07.565189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2490d-0045-47b7-92e8-cd1ef1772af0 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:07.565811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2490d-0045-47b7-92e8-cd1ef1772af0 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:07.566308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2490d-0045-47b7-92e8-cd1ef1772af0 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:07.567972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 70/140] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:07.573958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:07.574807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:07.575408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:07.600891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:07.612381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:07.615665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:07.773820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 71/141] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:07.785050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7faed-f353-43b5-b086-6c17440df081 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:07.845881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:07.846530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:07.846808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:07.847093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:07.851830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:07.853402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:07.855503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 71/142] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:07.863317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:07.957807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:08.022794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be97e85-ba4a-4f06-a7f3-c867c92fc611 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.069813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50895707-73d8-42a2-8035-e7066eedb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.070834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50895707-73d8-42a2-8035-e7066eedb617 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.071478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50895707-73d8-42a2-8035-e7066eedb617 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.071954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50895707-73d8-42a2-8035-e7066eedb617 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.072820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50895707-73d8-42a2-8035-e7066eedb617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:08.074823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50895707-73d8-42a2-8035-e7066eedb617 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:08.103565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 72/143] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:07 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:08.173670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.176942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7cc8-6069-497f-9ee0-d247e7261d9e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.177486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7cc8-6069-497f-9ee0-d247e7261d9e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.178000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7cc8-6069-497f-9ee0-d247e7261d9e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.179802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 73/144] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:08.191768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.192221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.192538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.225252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:08.232741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:08.318213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:08.338860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a36442-765a-40d2-885a-1f9476992780 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.388190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.388994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.392048 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.392344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.412305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:08.417564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:08.418395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:08.419166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:08.419755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 74/145] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:08.420557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 72/146] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:08.426915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.480148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:08.538953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fbccb-948a-4d48-870e-fffc77d7e574 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.576396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.577400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.577868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.578384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.579327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:08.579862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:08.581595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:08.591480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 75/147] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:08.597527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.727694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b166b0-6572-4de4-a084-09674f9847bb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.775880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.776864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.777329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.777783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] PATH_INFO: `/v3/users/d8e22d8515484ff1a1e66cd514ef1b87` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.779202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] RBAC: Authorizing `identity:get_user(user_id=d8e22d8515484ff1a1e66cd514ef1b87)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:08.780993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:08.782826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 73/148] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:08 2022] GET /identity/v3/users/d8e22d8515484ff1a1e66cd514ef1b87 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:08.788659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.900110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8eb3b-e622-4522-b8ad-61ec051ddaae None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.903530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:08.937863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.938850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.939384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.939843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.941311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:08.942995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:08.944958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 76/149] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:08 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:08.953400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.978275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:09.051107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.146018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b32acd-ce60-4a28-ade5-76c79d52c668 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.184584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9461eb-6b50-4017-8537-71a8e071fec6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.215070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.215925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.216594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.217001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b/users/d8e22d8515484ff1a1e66cd514ef1b87/roles/30361c25f36a4cb1b5c001474c0f029d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.223890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42940a322704827857570b326a06b8b, user_id=d8e22d8515484ff1a1e66cd514ef1b87, role_id=30361c25f36a4cb1b5c001474c0f029d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.225399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.229936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.230578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.230855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.231177 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.250349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 74/150] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:08 2022] PUT /identity/v3/projects/c42940a322704827857570b326a06b8b/users/d8e22d8515484ff1a1e66cd514ef1b87/roles/30361c25f36a4cb1b5c001474c0f029d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:09.251319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:09.257693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:09.258609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:09.260055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 77/151] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:09.265432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.370093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:09.404638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43122-8c92-4382-949e-a633fdaf46f0 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.449680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.450314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.450595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.451032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.452061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:09.452369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.454233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.464990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 75/152] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:09.471427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.518955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:09.600939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e187f1e-151f-40f5-b75c-6f60697de146 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.637234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950db9c8-7fab-40b3-9d3f-f324f9581f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.637937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db9c8-7fab-40b3-9d3f-f324f9581f49 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.638242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db9c8-7fab-40b3-9d3f-f324f9581f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.638548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db9c8-7fab-40b3-9d3f-f324f9581f49 None admin] PATH_INFO: `/v3/users/7d891070d24d41cb9c32f1d43f5c805b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.639879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950db9c8-7fab-40b3-9d3f-f324f9581f49 None admin] RBAC: Authorizing `identity:get_user(user_id=7d891070d24d41cb9c32f1d43f5c805b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.641356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950db9c8-7fab-40b3-9d3f-f324f9581f49 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.642980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 78/153] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/users/7d891070d24d41cb9c32f1d43f5c805b => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:09.649190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.730530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1ebb-fdcd-46eb-92b5-2fe19b54faee None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.730854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1ebb-fdcd-46eb-92b5-2fe19b54faee None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.731132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1ebb-fdcd-46eb-92b5-2fe19b54faee None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.732900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 79/154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:09.738740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.739115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.739341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.764411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:09.765774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.781729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b6e21-70c7-4b4f-870a-faf49a73863e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.867910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.868553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.869039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.869537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.873881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:09.900973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 80/155] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:09.965688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.967372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.078559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 76/156] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:10.084095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.148998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.298892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17653cf-fee6-46a2-81ef-f4cb681f242b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.361113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.361695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.361978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.362252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.363432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.364901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.366744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 81/157] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:10.372497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.430058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.464130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.518381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1d0bd-3c1e-4856-ba8d-1dc6cc1f73e6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.580837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.581473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.581757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.582017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.582770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=c42940a322704827857570b326a06b8b, user.id=7d891070d24d41cb9c32f1d43f5c805b) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:10.583152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.585251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.591525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 77/158] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/role_assignments?user.id=7d891070d24d41cb9c32f1d43f5c805b&scope.project.id=c42940a322704827857570b326a06b8b&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:10.622381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa43292-1b50-4c04-85ec-9a4ff0f78398 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.631436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.665115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77299197-1765-4a8d-98a3-c5f823e973aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.665986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77299197-1765-4a8d-98a3-c5f823e973aa None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.666357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77299197-1765-4a8d-98a3-c5f823e973aa None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.666774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77299197-1765-4a8d-98a3-c5f823e973aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.679605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77299197-1765-4a8d-98a3-c5f823e973aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-77299197-1765-4a8d-98a3-c5f823e973aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:10.689331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:10.690491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:10.691384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:10.694032 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 82/159] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:10.698735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.751253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f337-e760-46e6-9896-fe30f7e7215a None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.751747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f337-e760-46e6-9896-fe30f7e7215a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.753076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f337-e760-46e6-9896-fe30f7e7215a None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.755487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 83/160] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:10.762036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.762457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.762842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.791947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:10.793312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:10.918163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.926169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98e92-fb52-4ba4-b3eb-5d829cc961a6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.950608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 84/161] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:10.971511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.972183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.972407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.972685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.973427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:10.973734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.975182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.001758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 78/162] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:11.008359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.183103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a16d80-8e31-4cb7-a7a6-ab67aaa09da8 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.184735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:11.235034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.235715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.235994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.236256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.237407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.238967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.240900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 85/163] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:11.252348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.377820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a1e40-3600-4186-8e7f-3db9d72cb92f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.423158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10b4fb-3f77-434f-b3d5-731be6d51ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.423810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b4fb-3f77-434f-b3d5-731be6d51ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.424091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b4fb-3f77-434f-b3d5-731be6d51ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.424367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b4fb-3f77-434f-b3d5-731be6d51ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.463900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:11.507159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10b4fb-3f77-434f-b3d5-731be6d51ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.508658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10b4fb-3f77-434f-b3d5-731be6d51ce8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.558752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.631835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 79/164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:11.634277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b82a7-95d1-4225-8fc9-805840bde803 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.634776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b82a7-95d1-4225-8fc9-805840bde803 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.637100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b82a7-95d1-4225-8fc9-805840bde803 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.639639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 80/165] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:11.642111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b82a7-95d1-4225-8fc9-805840bde803 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.798957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:11.818313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b541e1f-77d7-4b58-9552-64a7005fb188 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.866452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b82a7-95d1-4225-8fc9-805840bde803 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.896171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20a9f7-330b-4c9b-b3cc-1bcabdd124ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.896822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20a9f7-330b-4c9b-b3cc-1bcabdd124ba None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.897094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20a9f7-330b-4c9b-b3cc-1bcabdd124ba None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.897348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20a9f7-330b-4c9b-b3cc-1bcabdd124ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.918462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20a9f7-330b-4c9b-b3cc-1bcabdd124ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7a20a9f7-330b-4c9b-b3cc-1bcabdd124ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:11.926276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:11.927907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 86/166] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:11.929585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.930970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.930970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.951671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.952339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.952615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.952885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.955909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.957471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.964262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 81/167] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:11.965079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.983218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:11.984699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:12.005889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:12.066983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 87/168] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:12.067910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.243604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d22a7-6f06-4137-86ef-4671c2809be2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.295168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92abd4-9d47-4743-8060-75f4bd0403ab None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.372749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.373085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.373359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.373628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.374489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] RBAC: Adding query filter params (role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=c42940a322704827857570b326a06b8b, user.id=4e466019f8ec487cb0208e3023b4adc5) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:12.374798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.376297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.387076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 88/169] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/role_assignments?user.id=4e466019f8ec487cb0208e3023b4adc5&scope.project.id=c42940a322704827857570b326a06b8b&role.id=e748222847a44424b09a5d0be46f4c05 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:12.391432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:12.428176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.428821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.429103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.429376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.430185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:12.430466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.431990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.466955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 82/170] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:12.504241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.527274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:12.663795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece77e2d-fe24-4d1e-986f-f17896219346 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.704502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.705792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.706260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.706720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.708183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.709836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.712060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 89/171] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:12.718842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.837851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.851306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c94141-a38d-4ac0-8279-d08c7a40552f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.891957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f76049-c8dc-4483-953d-1fd3783ed097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.892907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f76049-c8dc-4483-953d-1fd3783ed097 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.893322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f76049-c8dc-4483-953d-1fd3783ed097 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.893768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f76049-c8dc-4483-953d-1fd3783ed097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.986465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:12.999681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f76049-c8dc-4483-953d-1fd3783ed097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.004881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f76049-c8dc-4483-953d-1fd3783ed097 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.069766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:13.096550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162a34d-233c-4366-8260-2a774e5f0bc0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.164414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.165072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.165350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.165622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.187258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 83/172] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:13.188569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2be9-bef3-4bc7-b984-34635bf06fcb None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.188854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2be9-bef3-4bc7-b984-34635bf06fcb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.189131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2be9-bef3-4bc7-b984-34635bf06fcb None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.190383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 84/173] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:13.191370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:13.197466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:13.199560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:13.200856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:13.201730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.201730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.201730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.204492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 90/174] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:13.205451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.235852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:13.237134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:13.378022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7739-8c85-4f0c-9117-251568efdd51 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.394263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 85/175] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:13.396051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.429247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.430193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.430466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] PATH_INFO: `/v3/projects/a81613dabbcd40b595aed83f8fd80a99` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.434655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] RBAC: Authorizing `identity:get_project(project_id=a81613dabbcd40b595aed83f8fd80a99)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.436236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.437978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 91/176] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:13 2022] GET /identity/v3/projects/a81613dabbcd40b595aed83f8fd80a99 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:13.446989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.451560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:13.487507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:13.593546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70e5c-a979-4c4a-8df1-bf451bbf344d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.631628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.632252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.632532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.632802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.633492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:13.633792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.635225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb07b-7e31-45ee-b68c-3dfdef68cd90 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.645754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 86/177] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:13.647151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b413-40e2-42b2-9b9b-4bd19bc662e3 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.647438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b413-40e2-42b2-9b9b-4bd19bc662e3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.647709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b413-40e2-42b2-9b9b-4bd19bc662e3 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.649248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 87/178] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:13.650338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e2c46-4287-46a5-a3e5-6a93c01c8632 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.650709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e2c46-4287-46a5-a3e5-6a93c01c8632 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.650988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e2c46-4287-46a5-a3e5-6a93c01c8632 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.652293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 88/179] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:13.662035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e2c46-4287-46a5-a3e5-6a93c01c8632 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.680871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b2ddc-194c-4fd1-847e-60375f306b55 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.726890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.728021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.728221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.728645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.729383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, scope.project.id=a81613dabbcd40b595aed83f8fd80a99, user.id=4e466019f8ec487cb0208e3023b4adc5) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:13.729697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.731151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832299f3-232b-42cf-bc81-101cf5e164d0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.747257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 92/180] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:13 2022] GET /identity/v3/role_assignments?user.id=4e466019f8ec487cb0208e3023b4adc5&scope.project.id=a81613dabbcd40b595aed83f8fd80a99&role.id=67f08f193c9646cb847747a851778af2 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:13.747257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e428-177a-42b4-9d2f-55ac023bb728 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.747257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e428-177a-42b4-9d2f-55ac023bb728 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.747257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e428-177a-42b4-9d2f-55ac023bb728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.774510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4f40e428-177a-42b4-9d2f-55ac023bb728 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:13.777175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4f40e428-177a-42b4-9d2f-55ac023bb728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:13.793475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:13.817099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e2c46-4287-46a5-a3e5-6a93c01c8632 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.873979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47799279-baec-48b5-bb40-337eb80fade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.874973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799279-baec-48b5-bb40-337eb80fade0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.875447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799279-baec-48b5-bb40-337eb80fade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.875891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47799279-baec-48b5-bb40-337eb80fade0 None admin] PATH_INFO: `/v3/users/4e466019f8ec487cb0208e3023b4adc5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.877675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47799279-baec-48b5-bb40-337eb80fade0 None admin] RBAC: Authorizing `identity:get_user(user_id=4e466019f8ec487cb0208e3023b4adc5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.880240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47799279-baec-48b5-bb40-337eb80fade0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.882818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 89/181] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:13 2022] GET /identity/v3/users/4e466019f8ec487cb0208e3023b4adc5 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:13.892072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.892355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:13.892508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.892853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.900685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 93/182] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:13.902651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591aa76-cec9-4e60-819d-9fb5573e0fa2 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.903016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591aa76-cec9-4e60-819d-9fb5573e0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.903548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591aa76-cec9-4e60-819d-9fb5573e0fa2 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.905036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 94/183] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:13.906048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591aa76-cec9-4e60-819d-9fb5573e0fa2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.923969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:13.926029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:14.038103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 90/184] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:14.039316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.067815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591aa76-cec9-4e60-819d-9fb5573e0fa2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.108726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb50ad-dc38-45db-85bc-fc62c9383c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.109682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb50ad-dc38-45db-85bc-fc62c9383c2d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.109975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb50ad-dc38-45db-85bc-fc62c9383c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.110227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb50ad-dc38-45db-85bc-fc62c9383c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.124345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb50ad-dc38-45db-85bc-fc62c9383c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-befb50ad-dc38-45db-85bc-fc62c9383c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:14.129534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:14.132538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 95/185] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:14.133705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.135211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.135211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.154187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:14.155928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:14.172141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.209103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6660ae-3c1a-4ece-b7a5-2317bc324c8c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.239509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.250723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.251366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.251641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.251907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.253985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 96/186] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:14.256208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.352419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.354134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.398461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6d32-b497-4009-abb5-42c56e66f49b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.436724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.437517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.437916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.438292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.439105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:14.439513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.441031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.451037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 97/187] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:14.451477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.452061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.480404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 91/188] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:14.486593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.530641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.585009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70486bde-9d34-41fb-bc76-0890f9a236d4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.612721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd7246-2df6-42e9-b73d-e5da4e8fb266 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.630212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.630852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.631187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.631494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.632586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.634043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.635654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 98/189] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:14.636443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.660846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.661741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.662100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.662368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.673419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:14.678179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:14.680213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 92/190] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:14.681905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.744272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.759313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e95c55-1c5e-4ec2-9ebb-190a75a55906 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.780322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.798285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.799111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.799465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.799910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] PATH_INFO: `/v3/users/12df44ab768244f6ac8ba5c7c3b709e4` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.817257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] RBAC: Authorizing `identity:get_user(user_id=12df44ab768244f6ac8ba5c7c3b709e4)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.818800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.820543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 99/191] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/users/12df44ab768244f6ac8ba5c7c3b709e4 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:14.821307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.823557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c80191-2aa4-4681-a49b-2d4ec18f9eb7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.862327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.863025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.863289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.863562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.864704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.866221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.867926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 93/192] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:14.868681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.938472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0197d-e001-48f4-b280-2756eceafd0b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.977609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.978236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.978517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.978803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.990728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:14.995488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:14.996460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:14.997227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 100/193] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:14.997974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.998975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93636309-4442-4e41-a0d9-ffc462debfc5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.013919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.040960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.041573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.041862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.042119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.042761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.044309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.047467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.067789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 94/194] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:14 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:15.079376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.130640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb9c1d-29c9-4756-ae49-9209d1e046ae None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.175903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.176635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.176982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.177327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.178113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:15.178478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.180021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.191481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 101/195] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:15.199147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.233295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78a08b-202d-4ba9-90a0-e5f349f5e380 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.284847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.285653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.286051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.286418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.333817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.338703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.338896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3b329-42a8-43b0-8d3f-52cd99dc1723 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.389356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.389748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.389871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.390154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.390424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.391246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, scope.project.id=c42940a322704827857570b326a06b8b, user.id=4e466019f8ec487cb0208e3023b4adc5) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:15.391557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.392120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.393035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.400747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 102/196] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/role_assignments?user.id=4e466019f8ec487cb0208e3023b4adc5&scope.project.id=c42940a322704827857570b326a06b8b&role.id=67f08f193c9646cb847747a851778af2 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:15.402164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.583075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e94d-bcfe-42fd-a959-5ac8eb0abbb2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.598243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 95/197] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:15.599399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.642514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.643519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.644054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.644581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.645784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:15.646340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.648647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.664776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 103/198] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:15.666208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.679027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.718098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.722550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ca67-c4d7-411d-838d-bdd6c8314723 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.765706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.766662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.767095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.767492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] PATH_INFO: `/v3/users/d8e22d8515484ff1a1e66cd514ef1b87` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.773716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] RBAC: Authorizing `identity:get_user(user_id=d8e22d8515484ff1a1e66cd514ef1b87)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.776851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.779162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 96/199] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/users/d8e22d8515484ff1a1e66cd514ef1b87 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:15.780150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.854730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b1e-212a-4353-a3c3-de69d90bf229 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.891539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041318a-ca95-4cd9-a04f-53ba5e261679 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.913193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.914096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.914547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.914986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.916932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.919624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.923008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 104/200] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:15.924426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.941181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.941894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.942171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.942485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] PATH_INFO: `/v3/users/12df44ab768244f6ac8ba5c7c3b709e4` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] RBAC: Authorizing `identity:get_user(user_id=12df44ab768244f6ac8ba5c7c3b709e4)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.946548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.953263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 97/201] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/users/12df44ab768244f6ac8ba5c7c3b709e4 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:15.953263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.954053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.066562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.083828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6fe26-5717-48f3-85cc-99637e058ffe None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.127262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672fc9-5f26-4828-aea8-ca9ed1f59366 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.128200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.129407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.129873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.131307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.195929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.197451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.198526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.199390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.201150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=12df44ab768244f6ac8ba5c7c3b709e4) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:16.202319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.205529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:16.212855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.214364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:16.222039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 98/202] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/role_assignments?user.id=12df44ab768244f6ac8ba5c7c3b709e4&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:16.223882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:16.381548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.427895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.438047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 105/203] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:16.444676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:16.455985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14d120-c1ea-4bd9-87b9-b7df31cabfb9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.560117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0dd1-7f8f-48ac-b36d-403d6d44b8a2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.560328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.561219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.561683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.562134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.599385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.601773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.604437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.605787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.608262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.611591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:16.615994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 106/204] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:16 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:16.623571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:16.723814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.727022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:16.753232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.802795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a2326-6cf0-4cbb-99ed-835d6377823a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.850619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.860199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.861653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.862318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.862988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.864779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] RBAC: Adding query filter params (role.id=30361c25f36a4cb1b5c001474c0f029d, scope.project.id=c42940a322704827857570b326a06b8b, user.id=d8e22d8515484ff1a1e66cd514ef1b87) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:16.865382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.868618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:16.880699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 107/205] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:16 2022] GET /identity/v3/role_assignments?user.id=d8e22d8515484ff1a1e66cd514ef1b87&scope.project.id=c42940a322704827857570b326a06b8b&role.id=30361c25f36a4cb1b5c001474c0f029d => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:16.934841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 99/206] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:16.944845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.143366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1f435-94bf-4e33-b2d8-9ddda88a53ca None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.189284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:17.207471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e7115-58fc-4ba3-8716-c53c0c65a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.207471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7115-58fc-4ba3-8716-c53c0c65a205 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.207471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7115-58fc-4ba3-8716-c53c0c65a205 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.207471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7115-58fc-4ba3-8716-c53c0c65a205 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.210056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e7115-58fc-4ba3-8716-c53c0c65a205 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.211579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e7115-58fc-4ba3-8716-c53c0c65a205 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.213661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 108/207] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:16 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:17.223353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.420335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d638-579b-4c59-b698-cfc4d4f3dac9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.468658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b61b4-3bf6-4e85-accc-dc94fa9db888 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.468949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b61b4-3bf6-4e85-accc-dc94fa9db888 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.469268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b61b4-3bf6-4e85-accc-dc94fa9db888 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.470843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 109/208] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:17.476480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.476720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.477112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.492786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.494293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.495217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.495968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.496144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:17.497511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:17.498187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] RBAC: Adding query filter params (role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=12df44ab768244f6ac8ba5c7c3b709e4) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:17.499008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.503944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfffe8-e803-454a-8819-a65805974879 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.518781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 100/209] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:17 2022] GET /identity/v3/role_assignments?user.id=12df44ab768244f6ac8ba5c7c3b709e4&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=e748222847a44424b09a5d0be46f4c05 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:17.526333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e10f0-92c6-4fe1-92c7-fd50a3a90153 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.526620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e10f0-92c6-4fe1-92c7-fd50a3a90153 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.526914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e10f0-92c6-4fe1-92c7-fd50a3a90153 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.528451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 101/210] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:17.534535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.534796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.535111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.558344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:17.559806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:17.593257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:17.636744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 110/211] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:17.655685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 102/212] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:17.910093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.926926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.017522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3b244-3ab8-4293-80a8-7045aec82970 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.045117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.054473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc092-d97f-4a9d-81c8-5ba3f57c173c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.060920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.061859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.062323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.062887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.078152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:18.084463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:18.085338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:18.086132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:18.091148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 111/213] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:18.095956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.109077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.110205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.110673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.111338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.112875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.114536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.116865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 103/214] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:18.124744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.167197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.211698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86766be5-7e19-4812-8ef0-3f8fbf0a411d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.248841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.249535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.249729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.249980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.250650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:18.250948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.252376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.260855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 112/215] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:18.266448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.275993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4f758-952e-464d-b1e0-434be1709d41 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.323397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.324476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.325262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.326055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.327126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.328035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.330380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.363540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 104/216] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:18.405640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69df70-b60d-4f3b-a58e-34b6596b51bd None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.446394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4e0ea-5984-461d-aa45-9282967b1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.446988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4e0ea-5984-461d-aa45-9282967b1e3e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.447329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4e0ea-5984-461d-aa45-9282967b1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.447959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4e0ea-5984-461d-aa45-9282967b1e3e None admin] PATH_INFO: `/v3/users/58bcc6a3bf704a1aaa60d8c360f63b6d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.464770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4e0ea-5984-461d-aa45-9282967b1e3e None admin] RBAC: Authorizing `identity:get_user(user_id=58bcc6a3bf704a1aaa60d8c360f63b6d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.466640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4e0ea-5984-461d-aa45-9282967b1e3e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.468879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 113/217] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:18 2022] GET /identity/v3/users/58bcc6a3bf704a1aaa60d8c360f63b6d => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:18.477785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.608861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.640328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cad606-7331-4500-adcb-dc14b9612861 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.705005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.706427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.707215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.707953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.725711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b7b0-ddea-44bb-a1ae-36a3f8e971f3 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.725989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b7b0-ddea-44bb-a1ae-36a3f8e971f3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.726311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b7b0-ddea-44bb-a1ae-36a3f8e971f3 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.730491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 114/218] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:18.734791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.735282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.735609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.770190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:18.771887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.841786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.844928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.860270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 115/219] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:18.987510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.006444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 105/220] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:19.012490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.078816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.163540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b39b8-946e-4880-ad36-2faeb05e089a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.226126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.227176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.227176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.227466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.228434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.229887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.232430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 116/221] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:19.240104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.296397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.364727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ed5d-56d6-4018-a1da-a3a27e76fef2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.400986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.401606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.401887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.402160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.403064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=58bcc6a3bf704a1aaa60d8c360f63b6d) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:19.403699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.405282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.411313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 106/222] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/role_assignments?user.id=58bcc6a3bf704a1aaa60d8c360f63b6d&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=67f08f193c9646cb847747a851778af2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:19.442201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0857a0-22ea-4884-b71b-20d3b2c0bc95 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.443954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.498632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.499250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.499535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.499802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.512107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:19.517953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:19.518867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:19.519701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 117/223] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:19.525578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.587451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.642783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996bc7-affe-43d6-8382-b24b617f2bde None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.679703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.680408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.680688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.680958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.681641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:19.681942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.683358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35100fc-a3df-480f-90d1-9e82e86c2aaf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.693554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 107/224] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:19.699638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.801722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975bae-1a8d-4adf-990a-8f4419b12fd8 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.802019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975bae-1a8d-4adf-990a-8f4419b12fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.802175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975bae-1a8d-4adf-990a-8f4419b12fd8 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.803554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 108/225] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:19.808558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.808848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.809187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.842757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:19.843997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:19.873809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516fe4-f81c-4e8e-869b-252166fbc036 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.920414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 109/226] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:19.954466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.955145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.955427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.955696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] PATH_INFO: `/v3/users/12df44ab768244f6ac8ba5c7c3b709e4` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.959727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] RBAC: Authorizing `identity:get_user(user_id=12df44ab768244f6ac8ba5c7c3b709e4)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.961190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.962794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 118/227] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/users/12df44ab768244f6ac8ba5c7c3b709e4 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:19.968796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.018637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:20.081719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f73b4-3f53-48b1-a9c0-9c402b9370e1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.118364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.119004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.119312 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.119582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.120714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.123085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.125376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 110/228] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:20.130891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.198633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:20.319483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f6969-c28b-4cd5-920a-a79d014c6b22 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.372191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.372779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.373055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.373322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be/users/12df44ab768244f6ac8ba5c7c3b709e4/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.378888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea01b996ca24de4b927829827bbb0be, user_id=12df44ab768244f6ac8ba5c7c3b709e4, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.378998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.380410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.403788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 119/229] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:20 2022] PUT /identity/v3/projects/fea01b996ca24de4b927829827bbb0be/users/12df44ab768244f6ac8ba5c7c3b709e4/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:20.529301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d64a4-cec1-43c3-aa7b-83fcdd14150f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.543514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:20.582815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.583514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.583793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.584065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.601148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:20.605984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:20.606840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:20.607655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 111/230] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:20.613378 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.726899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:20.739227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a151e-8c3f-448f-b7ec-5b299d4a37d6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.779324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.779956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.780238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.780511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.781194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:20.781497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.782883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.791992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 120/231] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:20.797909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.909446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fbf52-5a26-493a-a96b-12bcb3c6f155 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.951437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dab85-aa91-4dbd-b188-f4451b70e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.952101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dab85-aa91-4dbd-b188-f4451b70e10c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.952383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dab85-aa91-4dbd-b188-f4451b70e10c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.952656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dab85-aa91-4dbd-b188-f4451b70e10c None admin] PATH_INFO: `/v3/users/12df44ab768244f6ac8ba5c7c3b709e4` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.953859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dab85-aa91-4dbd-b188-f4451b70e10c None admin] RBAC: Authorizing `identity:get_user(user_id=12df44ab768244f6ac8ba5c7c3b709e4)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.955361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dab85-aa91-4dbd-b188-f4451b70e10c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.957276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 112/232] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:20 2022] GET /identity/v3/users/12df44ab768244f6ac8ba5c7c3b709e4 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:20.962958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.996437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49bc54-319b-4de7-ba34-41c6623cd137 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.996625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49bc54-319b-4de7-ba34-41c6623cd137 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.996872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49bc54-319b-4de7-ba34-41c6623cd137 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.998412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 113/233] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:21.006283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56d12-3a38-4872-b68f-9d053f9ea58c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.006759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56d12-3a38-4872-b68f-9d053f9ea58c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.007032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56d12-3a38-4872-b68f-9d053f9ea58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.036440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-30b56d12-3a38-4872-b68f-9d053f9ea58c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:21.037787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-30b56d12-3a38-4872-b68f-9d053f9ea58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:21.091972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:21.116748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 114/234] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:21.124374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd5e9-e47a-4af5-9623-97702a23877e None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.124664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd5e9-e47a-4af5-9623-97702a23877e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.124943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd5e9-e47a-4af5-9623-97702a23877e None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.126538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 115/235] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:21.131427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.131712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.131990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.151739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:21.153014 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:21.198883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91b5b-ca8b-4626-845f-1da886088085 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.262867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.263561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.263840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.264114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.265851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:21.267363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:21.269215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 121/236] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:20 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:21.278448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.278851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 116/237] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:21.310847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:21.411841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.449669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebf21b-7b01-4412-b0d1-50e26a62ce48 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.511801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.513079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.513496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.514306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be/users/12df44ab768244f6ac8ba5c7c3b709e4/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.517970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea01b996ca24de4b927829827bbb0be, user_id=12df44ab768244f6ac8ba5c7c3b709e4, role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:21.522211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:21.550678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 122/238] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:21 2022] PUT /identity/v3/projects/fea01b996ca24de4b927829827bbb0be/users/12df44ab768244f6ac8ba5c7c3b709e4/roles/e748222847a44424b09a5d0be46f4c05 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:21.604301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.650650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:21.663938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb99f1-0311-46ec-80e8-c028c053f3d1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.775898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.776892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.777356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.778037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.790703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:21.804077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:21.809604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:21.810579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:21.811384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:21.813664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 117/239] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:21.820193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.827690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b89611-85df-4c64-868b-4139da9c3c60 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.897092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.898327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.898955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.899455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.901699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:21.905701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:21.909441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 123/240] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:21.915174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.035671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0ca1f-0d82-4e1a-beb8-5bd8e4d8d8a9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.077091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.077996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.078277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.079130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.080083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:22.081824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:22.098788 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26c04f-acb7-405f-8426-2ca53c699eac None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.119080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 124/241] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:21 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:22.163078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.163078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.163078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.163078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.163495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:22.163495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:22.163495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9e46-04fd-4c23-a1da-0232d371c92f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:22.172542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 118/242] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:22.179951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.188351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:22.277316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190f86-e8ce-4372-9e0c-e6587ec3f6a3 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.278222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190f86-e8ce-4372-9e0c-e6587ec3f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.278756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190f86-e8ce-4372-9e0c-e6587ec3f6a3 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.280985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 119/243] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:22.286759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.287406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.287876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.321255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:22.327734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:22.354563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973dc6f-9b62-4db8-98e9-6958a931241d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.358442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:22.408597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.409706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.410177 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.410666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] PATH_INFO: `/v3/users/987f2da2aa374134b468dfe29517b770` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.427614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=987f2da2aa374134b468dfe29517b770)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:22.429494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:22.431915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 125/244] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/users/987f2da2aa374134b468dfe29517b770 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:22.438776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.446007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 120/245] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:22.508721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:22.550148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65827-2873-4a94-9ecd-d87ea13fc8d9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.587233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.588228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.588697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.589155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.660183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:22.662027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:22.725346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:22.743676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.770150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 126/246] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:46:22.775733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.874787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b218a-001e-4a05-a31e-0cd219c1f235 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.891780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ce40-1e76-43c8-8136-d6f865694629 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.922298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.922948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.923274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.923510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.935342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.936323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.936813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.937290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.938744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:22.940603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:22.942501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 127/247] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:22.942761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:22.947864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:22.948833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:22.949862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:22.952588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 121/248] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:22.952848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.956631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.970614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:22.989176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:23.069646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126379ce-3e04-45d6-adbc-a01d5e24113b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.085912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208397f-2cd6-40ae-a739-380b260dfc42 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.113990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.114680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.114965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.115301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.116017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] RBAC: Adding query filter params (role.id=30361c25f36a4cb1b5c001474c0f029d, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=987f2da2aa374134b468dfe29517b770) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:23.116323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:23.118013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b24adf-cf9c-43e7-8c31-b590fbf3c74d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:23.125296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 128/249] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/role_assignments?user.id=987f2da2aa374134b468dfe29517b770&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=30361c25f36a4cb1b5c001474c0f029d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:23.126456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2550-89f7-4632-8dfa-7e110a036068 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.126739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2550-89f7-4632-8dfa-7e110a036068 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.127009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a2550-89f7-4632-8dfa-7e110a036068 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.127651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.132569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 129/250] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:23.132745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.132745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.132745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.132925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:23.133197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:23.134974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:23.135451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.135947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.136411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.147876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 122/251] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:23.154922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:23.159279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:23.160629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:23.259245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 130/252] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:23.282684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:23.327384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb669-470d-4c98-b8e7-e6c74e1a9826 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.380224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.380951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.381327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.381716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] PATH_INFO: `/v3/users/58bcc6a3bf704a1aaa60d8c360f63b6d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.382971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=58bcc6a3bf704a1aaa60d8c360f63b6d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:23.384552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:23.386535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 123/253] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:23 2022] GET /identity/v3/users/58bcc6a3bf704a1aaa60d8c360f63b6d => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:23.392607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:23.422917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:23.516407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdb22-d69d-4b27-8897-58e8e765002d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.554502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.555223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.555505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.555776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.556895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:23.558458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:23.560649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 131/254] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:23 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:23.566815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:23.719798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0d45-2308-461b-82a3-7bd692037ab5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.764161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:23.768673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.769637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.770126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.770606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be/users/58bcc6a3bf704a1aaa60d8c360f63b6d/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.772803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea01b996ca24de4b927829827bbb0be, user_id=58bcc6a3bf704a1aaa60d8c360f63b6d, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:23.774512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:23.797844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:23.810615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 124/255] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:23 2022] PUT /identity/v3/projects/fea01b996ca24de4b927829827bbb0be/users/58bcc6a3bf704a1aaa60d8c360f63b6d/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:23.930358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:23.941448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0741cb-a7e1-48bb-bde6-7736ec07d790 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.997425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165094f-b83f-4af5-a41e-ceb5ee6d1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.998010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165094f-b83f-4af5-a41e-ceb5ee6d1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.998297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165094f-b83f-4af5-a41e-ceb5ee6d1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.998568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165094f-b83f-4af5-a41e-ceb5ee6d1bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.011086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165094f-b83f-4af5-a41e-ceb5ee6d1bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7165094f-b83f-4af5-a41e-ceb5ee6d1bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:24.016223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:24.017134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:24.017961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 132/256] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:24.023461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.036473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0d18-d8ec-4a05-a770-0706be296b34 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.036767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0d18-d8ec-4a05-a770-0706be296b34 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.037396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0d18-d8ec-4a05-a770-0706be296b34 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.040742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 133/257] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:24.046344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.046799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.047113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.070557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:24.072695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:24.138648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9883d-2805-4d58-955c-bdff60fe4de3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:24.177267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:24.177897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.178180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.178456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.179173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:24.179484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:24.180908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:24.183863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 134/258] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:24.196640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 125/259] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:24.214106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.339730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:24.359110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7522b45-9ec1-4ee2-8ecc-73fdd67081f9 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:24.393406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:24.394044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.394320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.394596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] PATH_INFO: `/v3/users/12df44ab768244f6ac8ba5c7c3b709e4` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.395806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] RBAC: Authorizing `identity:get_user(user_id=12df44ab768244f6ac8ba5c7c3b709e4)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:24.397272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:24.399095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 135/260] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/users/12df44ab768244f6ac8ba5c7c3b709e4 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:24.405233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.475500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:24.521333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0296284-73fc-4e40-9a39-5704743aa2f2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:24.556795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:24.557579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.557912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.558196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.638718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:24.640260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:24.641308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.703828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:24.750929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 126/261] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:24.762312 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.859590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37535e8f-0d2f-4f7a-942f-8f02b4b36c9f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:24.870926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c50b0-b691-4210-b996-29f0a4242303 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:24.912732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:24.913293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.913573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.913848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.915118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:24.916596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:24.918674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 127/262] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:24.928123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.929308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:24.929969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.930248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.930515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:24.943286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:24.949606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:24.951510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:24.952578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 136/263] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:24.960622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:24.969365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:24.983704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:25.056449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5a1cb-5952-4712-95bf-c13e529a767a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:25.095676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:25.096317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.096596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.096880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.097640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=12df44ab768244f6ac8ba5c7c3b709e4) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:25.097954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:25.099624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:25.107483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 128/264] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/role_assignments?user.id=12df44ab768244f6ac8ba5c7c3b709e4&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:25.146373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f557d7-8095-4a96-91e1-1b3f5d145d48 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:25.208555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:25.209198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.209549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.209827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.210515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:25.210823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:25.212283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:25.227875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 137/265] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:25.234805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:25.376464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:25.386402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff254c2-0b44-4dba-8ef3-41d8b92f9f59 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:25.426003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d4254-def5-4521-9157-28e7d9a0c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:25.426650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d4254-def5-4521-9157-28e7d9a0c678 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.426928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d4254-def5-4521-9157-28e7d9a0c678 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.427233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d4254-def5-4521-9157-28e7d9a0c678 None admin] PATH_INFO: `/v3/users/12df44ab768244f6ac8ba5c7c3b709e4` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.428385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d4254-def5-4521-9157-28e7d9a0c678 None admin] RBAC: Authorizing `identity:get_user(user_id=12df44ab768244f6ac8ba5c7c3b709e4)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:25.429851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d4254-def5-4521-9157-28e7d9a0c678 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:25.431812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 129/266] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:25 2022] GET /identity/v3/users/12df44ab768244f6ac8ba5c7c3b709e4 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:25.437958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:25.520576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:25.552852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89746-3742-4849-9e7c-9fdf6df8c783 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:25.589270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:25.589968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.590245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.590515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.632034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446543e2-d72a-4f60-865d-23be3af0afb3 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.632658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446543e2-d72a-4f60-865d-23be3af0afb3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.633156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446543e2-d72a-4f60-865d-23be3af0afb3 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.639277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 130/267] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:25.641381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.641877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.642367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.663469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:25.665807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:25.668344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:25.670141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:25.751174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 131/268] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:25.768349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:25.818309 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 138/269] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:25.824222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:25.978612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:25.990805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329bd65-a350-4161-87a8-d25bbf5d2a5a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.045407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.046349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.046800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.047235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.051814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.053556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.055711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 132/270] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:25 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:26.062582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.087422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.202815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f12bb-fe75-4b04-83d8-b3bf3182e8a6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.203013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f057f-0644-4d72-b3f4-0fcd43bef447 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.243260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.244668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.245183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.245774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.248354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.249207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.249623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.250097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.251028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] RBAC: Adding query filter params (role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=12df44ab768244f6ac8ba5c7c3b709e4) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:26.251602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.253352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263276c8-4714-4341-a223-6e18a0f7595d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.259913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:26.261141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 139/271] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/role_assignments?user.id=12df44ab768244f6ac8ba5c7c3b709e4&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=e748222847a44424b09a5d0be46f4c05 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:26.263924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826c45-3fb5-4ac8-9a85-1c9ba79bb722 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.264535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826c45-3fb5-4ac8-9a85-1c9ba79bb722 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.265150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826c45-3fb5-4ac8-9a85-1c9ba79bb722 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:26.266320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:26.267274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:26.268383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:26.268988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 140/272] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:26.275619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.275619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.275619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.276166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 133/273] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:26.278246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.295557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:26.296915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.330249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.351642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.373171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 141/274] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:26.407521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2225-dd7a-4297-92ae-b6f7e63b0e45 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.459304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.460372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.460892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.461336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.462307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:26.462864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.464598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9767c-3f26-49ee-994a-77e843caf97e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.477498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 134/275] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:26.483752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.530398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab5dd-0e13-4738-8824-9732b38f382f None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.530981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab5dd-0e13-4738-8824-9732b38f382f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.531489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ab5dd-0e13-4738-8824-9732b38f382f None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.533102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 135/276] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:26.539197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.539755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.540199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.562982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:26.564522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.659398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6cd4-1dd2-42ec-933e-97d16932b046 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.675247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 136/277] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:26.688581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.702609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.718426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.718426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.719008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.719008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] PATH_INFO: `/v3/users/ec06b72d883141699b2a7ad405c34865` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.741490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] RBAC: Authorizing `identity:get_user(user_id=ec06b72d883141699b2a7ad405c34865)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.743116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.750453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 142/278] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/users/ec06b72d883141699b2a7ad405c34865 => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:26.754360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.792189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.840763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1b16d-f1f3-44a6-80b4-26724d7d22e0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.896527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.897795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.898298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.898793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.910602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1262f3b-b6b2-4772-8f52-047e539a1b08 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.914196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:26.919784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:26.920686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:26.921457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:26.924271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 137/279] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:26.936027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.956705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.957563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.958002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.958423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.959343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, user.id=ec06b72d883141699b2a7ad405c34865, scope.system=all) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:26.959857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.961512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.970199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 143/280] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/role_assignments?user.id=ec06b72d883141699b2a7ad405c34865&scope.system=all&role.id=67f08f193c9646cb847747a851778af2 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:26.976337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.050083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:27.094136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14193d1a-ed3f-4188-a0cb-3ed7dd7dd906 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.128299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:27.136689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.137578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.138179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.138179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.138891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:27.139214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.140656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d89b1-d1d7-4ee7-aeb2-c4a4872f8163 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.149967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f60c7-2a4b-4f7e-bf96-f7d590bdb1f8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.156937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 138/281] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:27.159579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90402-753a-4461-9a3f-30ffb604b0e8 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.160067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90402-753a-4461-9a3f-30ffb604b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.160581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90402-753a-4461-9a3f-30ffb604b0e8 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.163164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 139/282] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:27.165271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b90402-753a-4461-9a3f-30ffb604b0e8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.198087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86d35d-fe09-4420-8143-406c56f2e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.198747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d35d-fe09-4420-8143-406c56f2e930 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.199088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d35d-fe09-4420-8143-406c56f2e930 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.199367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d35d-fe09-4420-8143-406c56f2e930 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.200580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86d35d-fe09-4420-8143-406c56f2e930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.202056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86d35d-fe09-4420-8143-406c56f2e930 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.203983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 144/283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:27.205189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.205512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.205732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.226743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:27.228503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:27.329361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b90402-753a-4461-9a3f-30ffb604b0e8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.335211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 145/284] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:27.336471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.372833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:27.380600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.381349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.381548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.381821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] PATH_INFO: `/v3/users/987f2da2aa374134b468dfe29517b770` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.383004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] RBAC: Authorizing `identity:get_user(user_id=987f2da2aa374134b468dfe29517b770)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.384522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.386422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 140/285] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:27 2022] GET /identity/v3/users/987f2da2aa374134b468dfe29517b770 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:27.392015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.448887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:27.468461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412aa57-c4d6-4f52-b49e-59f8cb0d6525 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.510528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.511816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.512495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.512965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.513875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.515659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.543218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3e6e6-6d1a-4ef1-b0f1-10d4c12281a2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.546463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 146/286] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:27 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:27.593406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.593406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.593406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.593406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.596172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.596172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.598254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 141/287] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:27 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:27.603803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.665138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.729476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852a4ed-c801-4265-ac76-06eb70bbc103 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.758319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:27.785545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.786608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.787154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.787611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be/users/987f2da2aa374134b468dfe29517b770/roles/30361c25f36a4cb1b5c001474c0f029d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.790711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea01b996ca24de4b927829827bbb0be, user_id=987f2da2aa374134b468dfe29517b770, role_id=30361c25f36a4cb1b5c001474c0f029d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.792454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.813271 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 147/288] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:46:27 2022] PUT /identity/v3/projects/fea01b996ca24de4b927829827bbb0be/users/987f2da2aa374134b468dfe29517b770/roles/30361c25f36a4cb1b5c001474c0f029d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:27.822474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe7c55-7fc0-42cd-8736-c600b3310be1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.874386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.875273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.875606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.875932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.893608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:27.899156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:27.900930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:27.902603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 142/289] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:27.906947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.910812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:28.053202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efc95d-c4c9-40a4-8e33-1f7bad22f031 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.094282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.094924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.095238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.095513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.096210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:28.096510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.097984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.115936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 148/290] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:28.123209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.297042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bb1d6-5828-4420-a61b-1ba74f7a37d8 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.336440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:28.350432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.351255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.351668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.352004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] PATH_INFO: `/v3/users/58bcc6a3bf704a1aaa60d8c360f63b6d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.353438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] RBAC: Authorizing `identity:get_user(user_id=58bcc6a3bf704a1aaa60d8c360f63b6d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.355882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.358659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 143/291] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/users/58bcc6a3bf704a1aaa60d8c360f63b6d => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:28.364689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.471280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:28.518016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e404af-500a-41d7-a091-e8fb13980067 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.558590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.559254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.559541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.559818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.647716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.652810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.744294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:28.800170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 149/292] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:28.806490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.977230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ea80b-60cf-47d4-93a7-335f48a36cbb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:29.036205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0409b-b937-489e-9c38-e6419c2676b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:29.036856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0409b-b937-489e-9c38-e6419c2676b9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.037136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0409b-b937-489e-9c38-e6419c2676b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.037408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0409b-b937-489e-9c38-e6419c2676b9 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.039073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0409b-b937-489e-9c38-e6419c2676b9 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:29.040590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0409b-b937-489e-9c38-e6419c2676b9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:29.042566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 144/293] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:29.048338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:29.206174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453df8e-454c-4270-8a3e-32e786257375 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:29.256724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:29.257255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.257535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.257798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.258552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=58bcc6a3bf704a1aaa60d8c360f63b6d) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:29.258859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:29.260355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c288582-2871-41c0-ae90-1f5b02cbccb0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:29.270809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 150/294] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:29 2022] GET /identity/v3/role_assignments?user.id=58bcc6a3bf704a1aaa60d8c360f63b6d&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=67f08f193c9646cb847747a851778af2 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:29.486912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5b919-1b01-43b6-b131-b1023726fd11 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.487501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5b919-1b01-43b6-b131-b1023726fd11 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.487609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5b919-1b01-43b6-b131-b1023726fd11 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.489208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 145/295] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:29.495315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.495652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.495989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.524369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:29.525514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:29.563787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:29.640944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 151/296] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:29.978364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5b919-1b01-43b6-b131-b1023726fd11 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.053756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:30.109453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5b919-1b01-43b6-b131-b1023726fd11 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:30.144473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1c86-df7b-460d-9162-8ac2004ab667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:30.145112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1c86-df7b-460d-9162-8ac2004ab667 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.145386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1c86-df7b-460d-9162-8ac2004ab667 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.145652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1c86-df7b-460d-9162-8ac2004ab667 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.157676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1c86-df7b-460d-9162-8ac2004ab667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-153b1c86-df7b-460d-9162-8ac2004ab667 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:30.162612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:30.163572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:30.164353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:30.167234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 146/297] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:30.172865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.290853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4084c3-371e-42a1-9620-57ac310650ce None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:30.343978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d2eba-bdd6-4b79-a5a9-449422101cdb None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.344729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d2eba-bdd6-4b79-a5a9-449422101cdb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.345149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d2eba-bdd6-4b79-a5a9-449422101cdb None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.347099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 147/298] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:30.355097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5716-7f8f-47e4-aba9-fa77b80e3e30 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.355349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:30.355541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5716-7f8f-47e4-aba9-fa77b80e3e30 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.355673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.355819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5716-7f8f-47e4-aba9-fa77b80e3e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.355942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.355942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.356509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:30.356963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:30.358928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:30.372597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 152/299] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:30.384130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.385564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-3bcd5716-7f8f-47e4-aba9-fa77b80e3e30 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:30.388265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3bcd5716-7f8f-47e4-aba9-fa77b80e3e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:30.411444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:30.515902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 148/300] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:30.524579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475f65-f19e-48d0-9c41-4a9e8aa1a717 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.524879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475f65-f19e-48d0-9c41-4a9e8aa1a717 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.525132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475f65-f19e-48d0-9c41-4a9e8aa1a717 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.526478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 149/301] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:30.527834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f98f-5b51-4625-8036-4638c989197a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:30.533778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001712cd-e983-4edd-8409-ec05883633eb None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.534062 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001712cd-e983-4edd-8409-ec05883633eb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.534331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001712cd-e983-4edd-8409-ec05883633eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.553319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-001712cd-e983-4edd-8409-ec05883633eb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:30.554450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-001712cd-e983-4edd-8409-ec05883633eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:30.568149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:30.568790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.569071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.569343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] PATH_INFO: `/v3/users/ec06b72d883141699b2a7ad405c34865` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.570496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] RBAC: Authorizing `identity:get_user(user_id=ec06b72d883141699b2a7ad405c34865)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:30.572733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:30.574993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 153/302] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:30 2022] GET /identity/v3/users/ec06b72d883141699b2a7ad405c34865 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:30.580663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.622462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:30.659394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 150/303] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:30.668215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b845fa-e834-4ce3-b4db-d032afb63312 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.668497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b845fa-e834-4ce3-b4db-d032afb63312 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.668764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b845fa-e834-4ce3-b4db-d032afb63312 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.670588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 151/304] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:30.678286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.678590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.678942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.700737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:30.701950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:30.727381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:30.748849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecf914-7bb1-40c9-96f3-8e71eacbaeac None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:30.800253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:30.801928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.802500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.802970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] PATH_INFO: `/v3/system/users/ec06b72d883141699b2a7ad405c34865/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.805820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec06b72d883141699b2a7ad405c34865, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:30.807469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:30.815347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 152/305] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:30.819532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 154/306] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Aug 24 09:46:30 2022] PUT /identity/v3/system/users/ec06b72d883141699b2a7ad405c34865/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:30.879694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.981753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.040989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84cd6-274e-49ab-8380-fbec7bb0d40f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.060209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.087350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.088010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.088288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.088564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.106994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:31.114200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:31.115241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:31.116008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:31.116598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 153/307] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:31.123637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.147501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ef7e9-cf19-432f-8c64-8ddb0a64cd57 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.204672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.205298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.205588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.205865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.230513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:31.240355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:31.241308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:31.242128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:31.243639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 155/308] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:31.244637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.267146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.280210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffd6ab-5da7-4c3d-81e2-f7e8a2cc194d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.330230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.330919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.331339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.331704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.332659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:31.333056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.335270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.348366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 154/309] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:31.354811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.388433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4b2e5-dc75-4ce7-aa94-1d72ab86d5be None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.412644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.433908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.434549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.434823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.435114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.436209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.437669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.443122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 156/310] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:31.443122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.509249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b55788-b784-465f-bd87-cfe0d7628bf4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.548103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.553054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.553842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.554126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.554269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.554946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:31.555283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.556951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.565907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 155/311] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:31.568206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.582137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95568511-54b5-4f45-b39f-20448fb6bf26 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.630805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.631883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.632404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.632973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] PATH_INFO: `/v3/users/987f2da2aa374134b468dfe29517b770` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.634850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] RBAC: Authorizing `identity:get_user(user_id=987f2da2aa374134b468dfe29517b770)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.637473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.641223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 157/312] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/users/987f2da2aa374134b468dfe29517b770 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:31.642731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.709356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.714573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069a36d-81e0-4fea-80d9-6a64387b6cc9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.757928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.758558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.758829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.759134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] PATH_INFO: `/v3/groups` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.759780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.761297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.778726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 156/313] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Aug 24 09:46:31 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:31.778726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.791493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cff9dd-a158-4e4e-bf3e-eb1978295d74 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.837955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.838775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.839205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.839710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] PATH_INFO: `/v3/users/7ee4537173314135addcb0fc97c4bbb8` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.856183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee4537173314135addcb0fc97c4bbb8)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.858081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.865210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 158/314] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/users/7ee4537173314135addcb0fc97c4bbb8 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:31.866372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.877382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.940108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130a298-935b-422d-b906-38a321d109b3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:32.003774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:32.004427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.004707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.004974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.008167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353dcab-7994-4a48-bec6-0b4d146a8430 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:32.044550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:32.054437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:32.055867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.056336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.056855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.057820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] RBAC: Adding query filter params (role.id=30361c25f36a4cb1b5c001474c0f029d, user.id=7ee4537173314135addcb0fc97c4bbb8, scope.system=all) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:32.058490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:32.060228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:32.066210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 159/315] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/role_assignments?user.id=7ee4537173314135addcb0fc97c4bbb8&scope.system=all&role.id=30361c25f36a4cb1b5c001474c0f029d => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:32.105244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:32.106621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:32.221980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 157/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:32.227903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:32.330847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:32.384919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745e66-9fa4-48cd-a327-a1c70d3d8e58 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:32.425521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf425af1-4894-4b05-88e3-2850296a9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:32.426180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf425af1-4894-4b05-88e3-2850296a9100 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.426455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf425af1-4894-4b05-88e3-2850296a9100 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.426733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf425af1-4894-4b05-88e3-2850296a9100 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.428016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf425af1-4894-4b05-88e3-2850296a9100 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:32.429537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf425af1-4894-4b05-88e3-2850296a9100 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:32.432057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 160/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:32 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:32.439530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:32.508252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:32.554616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a528d-06ba-4b6f-b50a-2e752cd7153e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:32.592592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:32.593206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.593479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.593744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.594480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] RBAC: Adding query filter params (role.id=30361c25f36a4cb1b5c001474c0f029d, scope.project.id=fea01b996ca24de4b927829827bbb0be, user.id=987f2da2aa374134b468dfe29517b770) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:32.594784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:32.596279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554edf0f-9838-479a-aba3-8d25e640f0d9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:32.607164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 158/318] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:46:32 2022] GET /identity/v3/role_assignments?user.id=987f2da2aa374134b468dfe29517b770&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=30361c25f36a4cb1b5c001474c0f029d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:32.997761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3644c-9b79-475f-93be-586e680e2417 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.998052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3644c-9b79-475f-93be-586e680e2417 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.998429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3644c-9b79-475f-93be-586e680e2417 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.999704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 161/319] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:33.005792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:33.006125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:33.006514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:33.026668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:33.028171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:33.119107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 159/320] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:33.409557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3644c-9b79-475f-93be-586e680e2417 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:33.562769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3644c-9b79-475f-93be-586e680e2417 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:33.605217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:33.606016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:33.606163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:33.606378 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:33.616171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:33.622317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:33.627148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:33.628026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:33.628788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 162/321] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:33.635285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:33.712530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:33.778758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d255-e0f8-44b6-8cca-9e3c106feada None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:33.833127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:33.833865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:33.834148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:33.834419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:33.835137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:33.835461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:33.837149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d9e8b-4e17-479c-9e9d-3949049a2d7c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:33.851857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 160/322] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:33.853499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:33.893938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936140-e85f-4f72-b0af-b0fe5870833a None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:33.894230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936140-e85f-4f72-b0af-b0fe5870833a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:33.894513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71936140-e85f-4f72-b0af-b0fe5870833a None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:33.895993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 161/323] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:33.901151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:33.901417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:33.901688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:33.925239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:33.926791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:33.991299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa366db-b0c5-44ff-8821-ee5d44ed35de None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:34.015806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 162/324] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:34.039279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef797db4-6059-437f-a678-83fa14618f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:34.039917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef797db4-6059-437f-a678-83fa14618f50 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.040189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef797db4-6059-437f-a678-83fa14618f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.040451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef797db4-6059-437f-a678-83fa14618f50 None admin] PATH_INFO: `/v3/users/ec06b72d883141699b2a7ad405c34865` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.041590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef797db4-6059-437f-a678-83fa14618f50 None admin] RBAC: Authorizing `identity:get_user(user_id=ec06b72d883141699b2a7ad405c34865)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:34.043552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef797db4-6059-437f-a678-83fa14618f50 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:34.045331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 163/325] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:33 2022] GET /identity/v3/users/ec06b72d883141699b2a7ad405c34865 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:34.051719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:34.108370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:34.170833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9144009-464e-4fa1-977a-282c6a601a9d None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.171157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9144009-464e-4fa1-977a-282c6a601a9d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.171438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9144009-464e-4fa1-977a-282c6a601a9d None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.173054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 164/326] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:34.178027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.178315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.178591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.185115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124132e-4671-4870-a6b7-d1cddebb2108 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:34.198604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:34.200499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:34.228909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:34.229553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.229830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.230215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.230956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] RBAC: Adding query filter params (role.id=67f08f193c9646cb847747a851778af2, user.id=ec06b72d883141699b2a7ad405c34865, scope.system=all) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:34.231306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:34.232886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:34.251353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 163/327] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 09:46:34 2022] GET /identity/v3/role_assignments?user.id=ec06b72d883141699b2a7ad405c34865&scope.system=all&role.id=67f08f193c9646cb847747a851778af2 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:34.279799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:34.289935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 165/328] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:34.290528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:34.413548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d8a5-b3da-4e21-a99b-7895575d9088 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:34.415363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:34.456106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:34.456800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.456997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.457368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.458468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:34.460031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:34.461882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 164/329] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:34.467468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:34.563737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:34.589092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45578b-1387-43fe-9256-ccc1cb2c76a5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:34.630087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:34.631149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.631493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.631758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] PATH_INFO: `/v3/groups` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.632405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:34.633856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:34.658173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 166/330] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Aug 24 09:46:34 2022] POST /identity/v3/groups => generated 226 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:34.692995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e7b4c-abae-4933-9094-68be202c6a6d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:34.737966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:34.738620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.738901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.739216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.754342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:34.759742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:34.764463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:34.765989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 165/331] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:34.770422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:34.847535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:34.900628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cf1f4-b10b-427a-9876-3ad5b61c8c61 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:34.945169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:34.945791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:34.946074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:34.946344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:34.947357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:34.947659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:34.949071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:34.960538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 167/332] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:34.966549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:35.000886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:35.087021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1531296-46b4-4a5e-9d60-dad9e849cf74 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:35.131596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea27ac-f533-436e-8fcd-bab159aa08fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:35.132214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea27ac-f533-436e-8fcd-bab159aa08fc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:35.132496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea27ac-f533-436e-8fcd-bab159aa08fc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:35.132775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea27ac-f533-436e-8fcd-bab159aa08fc None admin] PATH_INFO: `/v3/users/7ee4537173314135addcb0fc97c4bbb8` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:35.133955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea27ac-f533-436e-8fcd-bab159aa08fc None admin] RBAC: Authorizing `identity:get_user(user_id=7ee4537173314135addcb0fc97c4bbb8)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:35.135473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea27ac-f533-436e-8fcd-bab159aa08fc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:35.137484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 166/333] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:34 2022] GET /identity/v3/users/7ee4537173314135addcb0fc97c4bbb8 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:35.143897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:35.280792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d785-e7da-4d55-a69e-fe5bf427f3a8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:35.303340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:35.327937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee8775-6ff9-426f-b791-080152dc29fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:35.329486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8775-6ff9-426f-b791-080152dc29fd None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:35.330019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8775-6ff9-426f-b791-080152dc29fd None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:35.330493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8775-6ff9-426f-b791-080152dc29fd None admin] PATH_INFO: `/v3/system/users/7ee4537173314135addcb0fc97c4bbb8/roles/30361c25f36a4cb1b5c001474c0f029d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:35.332318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee8775-6ff9-426f-b791-080152dc29fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7ee4537173314135addcb0fc97c4bbb8, role_id=30361c25f36a4cb1b5c001474c0f029d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:35.333977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee8775-6ff9-426f-b791-080152dc29fd None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:35.345408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 168/334] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Aug 24 09:46:35 2022] PUT /identity/v3/system/users/7ee4537173314135addcb0fc97c4bbb8/roles/30361c25f36a4cb1b5c001474c0f029d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:36.896590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446fa4-1057-465a-86be-9dd4c4d39a85 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:36.897620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446fa4-1057-465a-86be-9dd4c4d39a85 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:36.898215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4446fa4-1057-465a-86be-9dd4c4d39a85 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:36.900148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 167/335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:36.910807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1d6b6-a15b-4290-9b8a-a36b14f001dc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:36.911785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1d6b6-a15b-4290-9b8a-a36b14f001dc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:36.912256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1d6b6-a15b-4290-9b8a-a36b14f001dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:36.936344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-3ad1d6b6-a15b-4290-9b8a-a36b14f001dc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:36.937937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3ad1d6b6-a15b-4290-9b8a-a36b14f001dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:37.031881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 169/336] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:37.317638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94010220-ab2e-4c36-b225-ba275cbb8fdd None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:37.318295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94010220-ab2e-4c36-b225-ba275cbb8fdd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:37.318885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94010220-ab2e-4c36-b225-ba275cbb8fdd None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:37.320860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 168/337] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:37.328877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:37.329170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:37.329433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:37.356557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:37.360211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:37.450938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 170/338] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:37.633412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94010220-ab2e-4c36-b225-ba275cbb8fdd None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:37.790072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:37.799945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94010220-ab2e-4c36-b225-ba275cbb8fdd None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:37.845842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:37.846479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:37.846756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:37.847012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:37.860669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:37.868007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:37.868853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:37.869649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:37.870243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 169/339] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:37.880402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:37.959450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:38.038912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df031eb3-3448-4f7f-81e1-8b1907b61521 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.101132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:38.101937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.102300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.102746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.104484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:38.104925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:38.107825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:38.125284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:38.130870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 171/340] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:38.138313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:38.312466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b4a1-1fd0-488f-9267-7bfbaa2bb97e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.363308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe964148-991b-43f4-8862-caa2cd61bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:38.364313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964148-991b-43f4-8862-caa2cd61bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.364789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964148-991b-43f4-8862-caa2cd61bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.365346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964148-991b-43f4-8862-caa2cd61bdf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.380411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe964148-991b-43f4-8862-caa2cd61bdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-fe964148-991b-43f4-8862-caa2cd61bdf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:38.390034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:38.390955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:38.392087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:38.394818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 170/341] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:38.396758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b6c7-c960-48eb-ba9b-0148e1cf6e05 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.397453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b6c7-c960-48eb-ba9b-0148e1cf6e05 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.398114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407b6c7-c960-48eb-ba9b-0148e1cf6e05 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.400779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a03996-ed84-400f-830c-18f1e8015857 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.401594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 171/342] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:38.403195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ea9f-1e41-4209-865b-5dc7960b3e8c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.403794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ea9f-1e41-4209-865b-5dc7960b3e8c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.404262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ea9f-1e41-4209-865b-5dc7960b3e8c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.405432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:38.407867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 172/343] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:38.408934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ea9f-1e41-4209-865b-5dc7960b3e8c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:38.431520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:38.471754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef0efa-2848-4b8b-887d-6c02183a4f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:38.472728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0efa-2848-4b8b-887d-6c02183a4f1e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.473369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0efa-2848-4b8b-887d-6c02183a4f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.473606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0efa-2848-4b8b-887d-6c02183a4f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.535174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ea9f-1e41-4209-865b-5dc7960b3e8c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.571522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef0efa-2848-4b8b-887d-6c02183a4f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:38.573973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef0efa-2848-4b8b-887d-6c02183a4f1e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:38.578331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:38.579315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.579795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.580294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.581170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:38.581679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:38.583461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa18698-9969-4bad-b0d9-f5d96389fcd0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:38.595187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 173/344] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:38.596966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.597498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.597965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.624419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:38.626678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:38.680029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 172/345] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:38.681312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.681602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.681877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.695315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:38.708020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:38.709216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:38.718019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 174/346] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:38.719401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:38.734946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:38.783905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 173/347] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:38.784781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:38.851222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b3d8-bd05-4bb1-9e3b-e55faf4cfb61 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.894476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:38.895549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.896024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.896502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.972600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf3c03-4500-464d-9914-e9ecffffa667 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.980036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:38.982024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:38.995029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:39.051869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.052517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.052804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.053082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.054287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:39.055792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:39.057464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 174/348] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:38 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:39.063204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.069630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:39.120362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 175/349] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:39.128483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.267375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6bbab-3bc1-4c9f-8ea3-161554520e0f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.317239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.317878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.318157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.318422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.325017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:39.327302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:39.329285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 175/350] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:39.330066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.332749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8318a-c959-4584-9713-eab5b0822d25 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.346996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:39.376642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.377210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.377490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.377762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.379080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:39.382481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:39.382734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 176/351] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:39.384235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.431326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:39.490434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502c2b-d166-43ca-9f3c-c20c7ee362dc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.521043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb468e-7795-4bd4-81f5-9303b9047d70 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.548971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.550208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.550695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.551171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.563152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:39.568037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:39.568509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:39.569397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:39.570208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:39.570791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.570791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.570791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.570968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 176/352] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:39.570968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.584165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:39.588920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:39.589796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:46:39.590564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:39.591200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 177/353] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:39.591732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.642537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:39.709782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d46cd3-2d45-4799-8e72-22c083e0969d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.731087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8dc4-6300-4322-8b9d-8fbc4186d4ec None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.741835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:39.756530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.757176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.757397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.757668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.762338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=67f08f193c9646cb847747a851778af2, scope.project.id=c42940a322704827857570b326a06b8b) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:39.762338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:39.762338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc46e3b-df45-4482-9739-269c20383712 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:39.769203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 177/354] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=c42940a322704827857570b326a06b8b&role.id=67f08f193c9646cb847747a851778af2 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:39.769670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed156e82-50b0-4e5e-876f-4e06711698a3 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.769872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed156e82-50b0-4e5e-876f-4e06711698a3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.769989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed156e82-50b0-4e5e-876f-4e06711698a3 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.771466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 178/355] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:39.772456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08e25-5501-4ebd-a082-c03b089ff773 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.772736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08e25-5501-4ebd-a082-c03b089ff773 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.773006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08e25-5501-4ebd-a082-c03b089ff773 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.774403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 179/356] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:39.775237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08e25-5501-4ebd-a082-c03b089ff773 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.780384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:39.781335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:39.781954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:39.782330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:39.784646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:39.786961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:39.789095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 178/357] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:39.789941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:39.971489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08e25-5501-4ebd-a082-c03b089ff773 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.982805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06e6fa-2ccf-427a-90b7-e47cd6fae623 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:39.992504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:40.023637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:40.024301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.024550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.025303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.025518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:40.025823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:40.027411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758295-c4cd-4b88-aab7-cbae719d15b0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:40.043717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:40.044206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 180/358] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:40.044401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.044688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.044963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.045594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.045697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:40.045932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.046029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:40.046429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.047574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bdb49-2b4c-4e56-8d88-03cfa1501e79 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:40.062343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 179/359] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:40.063791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.064081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.064362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.069009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:40.070582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:40.090010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:40.091582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:40.131642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:40.163253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 181/360] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:40.164228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:40.201349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 180/361] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:40.202063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:40.336437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:40.344490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb55b28-5de2-4f3e-862d-96bc9387e0e8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:40.379305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55dcc-0731-40e2-9bf2-68b24b283729 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:40.403331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:40.404502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.404979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.405441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.477256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:40.477903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.478180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.478446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.479211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=67f08f193c9646cb847747a851778af2, scope.project.id=fea01b996ca24de4b927829827bbb0be) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:40.479523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:40.481385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:40.483829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:40.485522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:40.497382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 182/362] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:40 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=67f08f193c9646cb847747a851778af2 => generated 260 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:40.498105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:40.601808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:40.615104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 181/363] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:40.615104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:40.616776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:40.736410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738487d7-b9c4-4ba2-82a4-42a1ee136246 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:40.752098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72222951-53ea-49ad-bf41-b1955f6d4bc1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:40.795577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:40.796237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.796511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.796774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.799775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:40.800663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:40.801154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:40.801621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] PATH_INFO: `/v3/users/7ee4537173314135addcb0fc97c4bbb8` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:40.802975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] RBAC: Authorizing `identity:get_user(user_id=7ee4537173314135addcb0fc97c4bbb8)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:40.804837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:40.806711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 183/364] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:46:40 2022] GET /identity/v3/users/7ee4537173314135addcb0fc97c4bbb8 => generated 293 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:40.807751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:40.817283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:40.822456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:40.823405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:40.824532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 182/365] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:40.825850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:40.907281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:40.974453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a2548-4b6e-4a7f-ac39-1542dfc64541 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:40.974860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15886711-1263-4a1c-989f-9d2af1a6ea6e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:40.999314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:41.028866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.029811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.030226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.030690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.031705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.032620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.032731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.033127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.033570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.034617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:41.037271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 183/366] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:40 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:41.038967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.071294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:41.077530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:41.078646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:41.079550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:41.081951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 184/367] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:41.083003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.202007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61157f-5e6d-4889-82a9-9a04be0e3c15 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:41.238868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:41.260433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.261505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.263338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.264099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117da25-2266-459e-8e7e-51de8d335469 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:41.264547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.265449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] RBAC: Adding query filter params (role.id=30361c25f36a4cb1b5c001474c0f029d, user.id=7ee4537173314135addcb0fc97c4bbb8, scope.system=all) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:41.267391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.269001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:41.301927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 184/368] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/role_assignments?user.id=7ee4537173314135addcb0fc97c4bbb8&scope.system=all&role.id=30361c25f36a4cb1b5c001474c0f029d => generated 510 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:41.308330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.350623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.354442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.359578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.359881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.360611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:41.360951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.362353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:41.389239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 185/369] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:41.390131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.472710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:41.498887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4de167-ea68-45dd-a24f-b605ffa94987 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:41.553429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.554713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.555256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.555969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.557732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.560421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:41.563015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 185/370] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:41.568202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.586574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684942-b166-43c2-bbbf-8cad16168e16 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:41.632083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.633350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.633731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.634112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.635281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:41.635701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.637840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:41.645684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:41.654718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 186/371] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:41.654718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.721849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050064c-b015-44de-8229-8687b59a9f24 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:41.777136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dede5fa-4269-41ed-8dd9-19a8e196eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.778099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dede5fa-4269-41ed-8dd9-19a8e196eeaa None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.778580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dede5fa-4269-41ed-8dd9-19a8e196eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.779083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dede5fa-4269-41ed-8dd9-19a8e196eeaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.795126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:41.803282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41628-ccc8-4d97-a92c-11180a414871 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:41.846222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:41.846902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:41.848040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:41.848040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:41.848388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=c42940a322704827857570b326a06b8b) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:41.848683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.850550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:41.856694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 187/372] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=c42940a322704827857570b326a06b8b&role.id=e748222847a44424b09a5d0be46f4c05 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:41.857673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:41.925975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dede5fa-4269-41ed-8dd9-19a8e196eeaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:41.927973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dede5fa-4269-41ed-8dd9-19a8e196eeaa None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.032285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7161a9-b0ff-44a2-bc07-17cba89ec28c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:42.042035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.104296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:42.104983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.105264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.105539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.141855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 186/373] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:42.148191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feff60-88f8-43fe-bdaf-a0e9897bdfc5 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.148557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feff60-88f8-43fe-bdaf-a0e9897bdfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.148742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feff60-88f8-43fe-bdaf-a0e9897bdfc5 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.152830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 187/374] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:42.152830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feff60-88f8-43fe-bdaf-a0e9897bdfc5 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.167492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.209140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:42.215081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.275575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feff60-88f8-43fe-bdaf-a0e9897bdfc5 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:42.315480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeafe69-9502-4a67-85ea-be6b09448cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:42.316167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafe69-9502-4a67-85ea-be6b09448cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.316449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafe69-9502-4a67-85ea-be6b09448cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.316716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeafe69-9502-4a67-85ea-be6b09448cd8 None admin] PATH_INFO: `/v3/projects/0090fa1c947541c19958fa29c1afd1ff` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.319566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeafe69-9502-4a67-85ea-be6b09448cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=0090fa1c947541c19958fa29c1afd1ff)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:42.321109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeafe69-9502-4a67-85ea-be6b09448cd8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.323150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 188/375] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/projects/0090fa1c947541c19958fa29c1afd1ff => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:42.324113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 188/376] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:42.325151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.325433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.325705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.329845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.349252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:42.350515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:42.366770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.400253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.429089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 189/377] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:42.429956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.454084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9761b8-fdca-4a3c-87f0-384b6af65ea0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:42.510085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:42.510731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.511039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.512816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] PATH_INFO: `/v3/groups/7877118f62ec408fa76c54d08fe5bc93` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.522206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] RBAC: Authorizing `identity:get_group(group_id=7877118f62ec408fa76c54d08fe5bc93)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:42.523732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.529354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 189/378] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/groups/7877118f62ec408fa76c54d08fe5bc93 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:42.535186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.601146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f57a4-0506-4c33-8a66-59c17e8dcadb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:42.686911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:42.687598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.687875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.688145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.690522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:42.692019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.698351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 190/379] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:42.702413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.747102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.763407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a5bf-b24a-4937-b92a-9f66ffd9e2a0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:42.818250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.831384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:42.832055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.832340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.832612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.833357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] RBAC: Adding query filter params (group.id=7877118f62ec408fa76c54d08fe5bc93, role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=0090fa1c947541c19958fa29c1afd1ff) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:42.833664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:42.835161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.842641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 190/380] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/role_assignments?group.id=7877118f62ec408fa76c54d08fe5bc93&scope.project.id=0090fa1c947541c19958fa29c1afd1ff&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 260 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:42.845519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.898231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7284fa-fac9-45b7-b370-d3e2623929e3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:42.948402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:42.949621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:42.950085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:42.950557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:42.952142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:42.954079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:42.957833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 191/381] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:42.966646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:42.975808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376b4b4-7717-4544-837e-c6235ddcd208 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.019386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d080e-32f7-43e8-82b4-06a2120b84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:43.020068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d080e-32f7-43e8-82b4-06a2120b84c3 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.020342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d080e-32f7-43e8-82b4-06a2120b84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.020612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d080e-32f7-43e8-82b4-06a2120b84c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.040689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d080e-32f7-43e8-82b4-06a2120b84c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-c21d080e-32f7-43e8-82b4-06a2120b84c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:43.049015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:43.050013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:43.050865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 191/382] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:43.051594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a5eba-7e14-4c91-a84b-6647c8da0d6b None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.052241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a5eba-7e14-4c91-a84b-6647c8da0d6b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.052241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a5eba-7e14-4c91-a84b-6647c8da0d6b None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.053800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 192/383] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:43.063254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.063549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.063907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.087802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:43.089023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:43.134279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:43.153740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dad5e-7936-47be-9c21-34bf00db943b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.172229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:43.203472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:43.204666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.205170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.205883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.207116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=fea01b996ca24de4b927829827bbb0be) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:43.207670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:43.210590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:43.211182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 193/384] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:43.212193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:43.223808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 192/385] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:42 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=e748222847a44424b09a5d0be46f4c05 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:43.362151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbc6fc-2b79-4c02-8641-bba0c6b13973 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.415830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:43.417315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.418044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.418832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.420424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:43.421495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:43.426724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:43.441970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 194/386] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:43.448392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:43.575513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fd1df-8bbf-4122-bad2-8661f0d8b4f8 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.617429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:43.618455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.618964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.619453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.620856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:43.622681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:43.624921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 193/387] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:43 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:43.630735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:43.642826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:43.691494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:43.709067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:43.792158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a887a9-cc1a-4869-b432-48ccb20453f1 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.818018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59895e6-b0cd-4fe3-84cb-df597851d3ef None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.853379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:43.854022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.854297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.854563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.859769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:43.860614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:43.861237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:43.861366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:43.861693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:43.862028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:43.863284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 195/388] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:43 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:43.868790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:43.873155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:43.878542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:43.879427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:43.880207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 194/389] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:43.886230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:43.983150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95a8c-ae67-4517-a7a8-0863422195f8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:43.996920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:44.029811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2033-886c-49c9-a405-07197febc266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:44.030728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2033-886c-49c9-a405-07197febc266 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.031189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2033-886c-49c9-a405-07197febc266 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.031608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2033-886c-49c9-a405-07197febc266 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b/groups/524de11913414f808228521984948a5c/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.035069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2033-886c-49c9-a405-07197febc266 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42940a322704827857570b326a06b8b, group_id=524de11913414f808228521984948a5c, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:44.037471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2033-886c-49c9-a405-07197febc266 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:44.061122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 196/390] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 09:46:43 2022] PUT /identity/v3/projects/c42940a322704827857570b326a06b8b/groups/524de11913414f808228521984948a5c/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:44.087450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:44.110258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b23cc-7e55-47d4-80ed-736fffbd95de None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:44.170958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:44.171623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.171905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.172179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.172877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:44.173180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:44.174615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:44.189608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 195/391] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:44.195952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2033-886c-49c9-a405-07197febc266 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:44.361485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2033-886c-49c9-a405-07197febc266 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:44.400027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c88cd-53bb-43bc-85f2-76f75a38ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:44.400674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c88cd-53bb-43bc-85f2-76f75a38ba7d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.400964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c88cd-53bb-43bc-85f2-76f75a38ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.401232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c88cd-53bb-43bc-85f2-76f75a38ba7d None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.402440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c88cd-53bb-43bc-85f2-76f75a38ba7d None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:44.404046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c88cd-53bb-43bc-85f2-76f75a38ba7d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:44.405963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 197/392] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:44 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:44.412254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:44.528862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f4c3f-a5e3-4f8e-a4ee-fb31bb48b35f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:44.564696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:44.565340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.565623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.565897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.567093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:44.568574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:44.569772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6765b-787e-4a1a-8c32-bf0342419926 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.570062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6765b-787e-4a1a-8c32-bf0342419926 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.570400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6765b-787e-4a1a-8c32-bf0342419926 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.570632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 196/393] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:44 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:44.572264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 198/394] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:44.576996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:44.577998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.578285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.578561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.592205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:44.599612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:44.600860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:44.633936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:44.687230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 199/395] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:44.698955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2818-02c8-40a4-9655-587b38ac6daa None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:44.760981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:44.762284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:44.762622 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:44.762900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be/groups/524de11913414f808228521984948a5c/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:44.765615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] RBAC: Authorizing `identity:create_grant(project_id=fea01b996ca24de4b927829827bbb0be, group_id=524de11913414f808228521984948a5c, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:44.768370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:44.790288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 197/396] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 09:46:44 2022] PUT /identity/v3/projects/fea01b996ca24de4b927829827bbb0be/groups/524de11913414f808228521984948a5c/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:45.018608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:45.135682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520c95b-dd97-422b-aa08-a67b97859dee None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:45.189626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383d354-2cef-487e-9dec-c230d837b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:45.190655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d354-2cef-487e-9dec-c230d837b571 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.191168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d354-2cef-487e-9dec-c230d837b571 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.191627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383d354-2cef-487e-9dec-c230d837b571 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.209704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383d354-2cef-487e-9dec-c230d837b571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f383d354-2cef-487e-9dec-c230d837b571 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:45.214866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:45.215762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:45.216557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:45.219314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 200/397] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:45.225273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:45.312950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:45.358112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09a71-b288-40f9-ab49-46c323cacd2c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:45.378100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6bca8-f135-4152-a501-f0209dbe8f10 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.378406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6bca8-f135-4152-a501-f0209dbe8f10 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.378666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6bca8-f135-4152-a501-f0209dbe8f10 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.380199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 201/398] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:45.385707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.386072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.386374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.416307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:45.416929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.417248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.417925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.419020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:45.419349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:45.422242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:45.424050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:45.425242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:45.447243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 198/399] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:45.469986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:45.470584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:45.571198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 202/400] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:45.627987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61160-d782-4adb-874b-9e72add21fc8 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:45.666837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:45.673362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e288f0-ff6a-494f-a4ce-59a6cad15e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:45.674294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e288f0-ff6a-494f-a4ce-59a6cad15e07 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.674771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e288f0-ff6a-494f-a4ce-59a6cad15e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.675272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e288f0-ff6a-494f-a4ce-59a6cad15e07 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.676688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e288f0-ff6a-494f-a4ce-59a6cad15e07 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:45.678439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e288f0-ff6a-494f-a4ce-59a6cad15e07 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:45.680601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 199/401] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:45 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:45.686459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:45.706290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cc3c-d50f-4c95-a808-5c616ec6553c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.706641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cc3c-d50f-4c95-a808-5c616ec6553c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.706943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81cc3c-d50f-4c95-a808-5c616ec6553c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.708458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 200/402] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:45.713437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.713738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.713934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.736675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:45.738217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:45.846047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 201/403] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:45.872796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3655e-6b6c-437c-a15e-be21e9904551 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:45.921577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:45.922312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:45.922596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:45.922864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:45.924018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:45.925466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:45.927484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 203/404] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:45 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:45.933168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:45.992424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.038217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:46.152375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e40466-fbd0-4c54-afdb-39de495b5d0b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.174355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4b4b9-e174-49be-a5c5-e659599e769c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.186827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:46.195976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.196635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.197237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.197519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b/groups/524de11913414f808228521984948a5c/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.199731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42940a322704827857570b326a06b8b, group_id=524de11913414f808228521984948a5c, role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:46.201139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:46.223214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 202/405] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 09:46:45 2022] PUT /identity/v3/projects/c42940a322704827857570b326a06b8b/groups/524de11913414f808228521984948a5c/roles/e748222847a44424b09a5d0be46f4c05 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:46.224364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.231888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.232799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.233220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.233709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.259077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:46.268938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:46.270101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:46.271101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:46.278044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 204/406] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:46.288331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.435916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be78d1-080a-408b-a79f-5ddc52349570 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.449688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:46.474875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc263b-917b-4b65-a0c5-4554b8c529d4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.488725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.489363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.489732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.490010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.502263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:46.508512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:46.509417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:46.510198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 203/407] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:46.517506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.532502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.533124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.533398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.533663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.534335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:46.534632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:46.536119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:46.550278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 205/408] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:46.556268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.596903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:46.653990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f931c-861f-4d59-935e-12e96983afcf None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.694481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.695504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.695998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.696472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.697666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:46.698160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:46.699901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d312dcc-2936-441e-be55-8f06f4b8d622 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:46.705482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad5202-9a7d-409e-83bc-b4b42238824d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.714789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 204/409] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:46.716504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248159-8263-43ff-bb07-0c5c372948a9 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.716996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248159-8263-43ff-bb07-0c5c372948a9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.717464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248159-8263-43ff-bb07-0c5c372948a9 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.719264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 205/410] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:46.724535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28248159-8263-43ff-bb07-0c5c372948a9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.748294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96208c1-8e75-4119-ad9c-37d601f04c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.748940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96208c1-8e75-4119-ad9c-37d601f04c52 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.749219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96208c1-8e75-4119-ad9c-37d601f04c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.749492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96208c1-8e75-4119-ad9c-37d601f04c52 None admin] PATH_INFO: `/v3/groups/7877118f62ec408fa76c54d08fe5bc93` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.751091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96208c1-8e75-4119-ad9c-37d601f04c52 None admin] RBAC: Authorizing `identity:get_group(group_id=7877118f62ec408fa76c54d08fe5bc93)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:46.752866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96208c1-8e75-4119-ad9c-37d601f04c52 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:46.755376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 206/411] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/groups/7877118f62ec408fa76c54d08fe5bc93 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:46.756943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.757226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.757497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.777956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:46.779582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:46.793826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:46.861407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28248159-8263-43ff-bb07-0c5c372948a9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:46.867401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 207/412] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:46.868107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:46.888818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:46.939305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:46.939954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:46.940230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:46.940497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:46.941603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:46.943127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:46.945210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 206/413] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:46.952234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:47.049155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49636c-4d33-4765-b489-8c16b3888799 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.117212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.117847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.118120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.118380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] PATH_INFO: `/v3/projects/0090fa1c947541c19958fa29c1afd1ff` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.120160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] RBAC: Authorizing `identity:get_project(project_id=0090fa1c947541c19958fa29c1afd1ff)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:47.121766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:47.125439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 208/414] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/projects/0090fa1c947541c19958fa29c1afd1ff => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:47.131708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:47.160695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:47.169525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daeeae-0615-4410-8d05-abe974f9b035 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.224734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.225406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.225695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.225968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.228346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:47.233002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:47.236121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 207/415] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:46 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:47.236963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:47.297132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:47.304198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c706-470a-4817-af5d-b95b11eac48c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.345954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.346888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.347220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.347510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] PATH_INFO: `/v3/projects/0090fa1c947541c19958fa29c1afd1ff/groups/7877118f62ec408fa76c54d08fe5bc93/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.349419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] RBAC: Authorizing `identity:create_grant(project_id=0090fa1c947541c19958fa29c1afd1ff, group_id=7877118f62ec408fa76c54d08fe5bc93, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:47.350873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:47.359008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7d69b-c707-4380-a5bd-c34b402fa3c4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.365099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 209/416] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 09:46:47 2022] PUT /identity/v3/projects/0090fa1c947541c19958fa29c1afd1ff/groups/7877118f62ec408fa76c54d08fe5bc93/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:47.365901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:47.428816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168a59c-7769-4068-b372-7c4d689d2003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.429739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a59c-7769-4068-b372-7c4d689d2003 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.430266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a59c-7769-4068-b372-7c4d689d2003 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.430672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168a59c-7769-4068-b372-7c4d689d2003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.445300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168a59c-7769-4068-b372-7c4d689d2003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-2168a59c-7769-4068-b372-7c4d689d2003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:47.452421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:47.453578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:47.454583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:47.457229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 208/417] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:47.459075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76bc1-89b9-4c5e-a2f5-a0f1ff6295a9 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.459855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76bc1-89b9-4c5e-a2f5-a0f1ff6295a9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.460353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76bc1-89b9-4c5e-a2f5-a0f1ff6295a9 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.469138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 209/418] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:47.470427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76bc1-89b9-4c5e-a2f5-a0f1ff6295a9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:47.485318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:47.516299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf186-cb03-4f69-9426-09c216d2509d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.562624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166c38b-987f-4b25-ac1b-74052fb52ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.563379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166c38b-987f-4b25-ac1b-74052fb52ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.563663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166c38b-987f-4b25-ac1b-74052fb52ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.563939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166c38b-987f-4b25-ac1b-74052fb52ef3 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be/groups/524de11913414f808228521984948a5c/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.566241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166c38b-987f-4b25-ac1b-74052fb52ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea01b996ca24de4b927829827bbb0be, group_id=524de11913414f808228521984948a5c, role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:47.567838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166c38b-987f-4b25-ac1b-74052fb52ef3 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:47.583027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 210/419] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Aug 24 09:46:47 2022] PUT /identity/v3/projects/fea01b996ca24de4b927829827bbb0be/groups/524de11913414f808228521984948a5c/roles/e748222847a44424b09a5d0be46f4c05 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:47.584343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.584662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.584965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.607276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:47.608987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:47.611863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76bc1-89b9-4c5e-a2f5-a0f1ff6295a9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.620681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:47.686352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.687743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.688215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.688644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.689509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:47.689976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:47.691595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:47.709451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 210/420] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:47.715717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:47.733173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 211/421] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:47.844133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6e5f-f709-4bd5-a491-5cc7f61a7c1f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:47.882144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:47.882753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:47.883027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:47.883325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:47.929298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:47.974827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:47.976254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:48.021317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:48.094845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 211/422] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:46:48.097228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:48.102412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:48.143689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd1663-8cb8-4500-b295-c1b42af795ca None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:48.182025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:48.182702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.183300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.183403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.202107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:48.206878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:48.207738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:48.208921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 212/423] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:48.209784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:48.221621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:48.286052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb3bc-1f43-4a54-a321-79aa1b68dd3d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:48.356799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e556c-73ff-4966-b331-ed018ecb2687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:48.357444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e556c-73ff-4966-b331-ed018ecb2687 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.357724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e556c-73ff-4966-b331-ed018ecb2687 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.357991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e556c-73ff-4966-b331-ed018ecb2687 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.362187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e556c-73ff-4966-b331-ed018ecb2687 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:48.363727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e556c-73ff-4966-b331-ed018ecb2687 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:48.365846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 212/424] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:48.367190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5de87-132c-44e3-8539-f3b40f6a2a2f None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.367471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5de87-132c-44e3-8539-f3b40f6a2a2f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.367740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5de87-132c-44e3-8539-f3b40f6a2a2f None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.369316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 213/425] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:48.372639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5de87-132c-44e3-8539-f3b40f6a2a2f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:48.380531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53797f5f-969a-4786-9aa7-3be8c99c4b2e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:48.405511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:48.416864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:48.418301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.418593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.418865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.419580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] RBAC: Adding query filter params (name=member) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:48.419878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:48.421282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aca58-188a-458d-bef9-b0f887950158 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:48.430463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 213/426] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:48.431729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.432010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.432289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.450619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:48.452159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:48.505806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5de87-132c-44e3-8539-f3b40f6a2a2f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:48.547564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 214/427] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:48.549241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:48.555803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:48.556600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.556878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.557151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.558636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:48.560127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:48.562041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 214/428] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:48.568717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:48.575088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:48.728619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b08675-7b0e-4236-bc97-e59d6f9c914b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:48.768425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:48.769180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.769463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.769740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.770485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=67f08f193c9646cb847747a851778af2, scope.project.id=c42940a322704827857570b326a06b8b) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:48.770798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:48.772305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:48.780276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 215/429] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=c42940a322704827857570b326a06b8b&role.id=67f08f193c9646cb847747a851778af2 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:48.841400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f12f3c-94cb-486b-bd11-c475500ca69b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:48.877234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:48.902325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:48.903213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:48.903671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:48.904099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:48.918862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.038779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.043194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.045340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.094242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269d812-0852-46c2-8b81-89720303aadb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.159918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.161012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.161506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.161975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.175747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:49.181594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:49.182475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:49.183804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:49.186625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 216/430] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:49.192496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.199090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 215/431] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:49.203399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.231505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.338695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80b97-7a89-4323-afa7-a201c0aaf5dc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.363935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba67d9-8adb-4520-ae1f-e2155c2977b6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.387910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.389222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.389687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.390221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.391646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.393453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.395798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 216/432] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:49.400746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.411904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.412884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.413343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.413775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.414880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:49.415584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.416753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.418105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.436865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 217/433] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:49.442780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.525518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.545869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a92d-ff2d-4748-a592-97beb19528c9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.586014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.587020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.587671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.588228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.589610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.591304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.591620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82919e70-b394-4b0e-aca6-308c65228c78 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.593819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 217/434] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:49.599968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.628890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d0fd-ff01-4361-8a12-dc86d1b10664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.629476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d0fd-ff01-4361-8a12-dc86d1b10664 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.629776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d0fd-ff01-4361-8a12-dc86d1b10664 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.630123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d0fd-ff01-4361-8a12-dc86d1b10664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.694902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.707362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d0fd-ff01-4361-8a12-dc86d1b10664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.709014 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d0fd-ff01-4361-8a12-dc86d1b10664 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.716543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817fa69-dfa7-4c75-9f09-db1343833582 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.758139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.758992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.759529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.759979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.761042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=67f08f193c9646cb847747a851778af2, scope.project.id=fea01b996ca24de4b927829827bbb0be) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:49.761829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.763631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.770858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 218/435] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=67f08f193c9646cb847747a851778af2 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:49.825897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 218/436] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:49.834863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.844630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637d77-e2cc-476c-b0ba-f18125892155 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.844948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637d77-e2cc-476c-b0ba-f18125892155 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.845190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637d77-e2cc-476c-b0ba-f18125892155 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.846656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 219/437] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:49.855827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.856637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.857331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.863612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.895687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:49.899376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:49.994537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3b7c-67ea-45ed-b251-63c146535323 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.000831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 220/438] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:50.032109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef6f11-6c71-4c1e-9f77-eb1de1ab9ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.032754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef6f11-6c71-4c1e-9f77-eb1de1ab9ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.033034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef6f11-6c71-4c1e-9f77-eb1de1ab9ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.033295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef6f11-6c71-4c1e-9f77-eb1de1ab9ee5 None admin] PATH_INFO: `/v3/projects/c42940a322704827857570b326a06b8b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.034428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef6f11-6c71-4c1e-9f77-eb1de1ab9ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=c42940a322704827857570b326a06b8b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:50.035933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef6f11-6c71-4c1e-9f77-eb1de1ab9ee5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:50.037913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 219/439] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/projects/c42940a322704827857570b326a06b8b => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:50.043473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.067264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:50.151767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d136827-bcd5-4e40-9abb-1633924fdbff None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.193671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.194352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.194626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.194896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.196371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:50.198183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:50.200101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 221/440] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:50.206892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291de53-328d-415c-8e3b-e47416a99148 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.206892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291de53-328d-415c-8e3b-e47416a99148 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.206892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291de53-328d-415c-8e3b-e47416a99148 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.206892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 220/441] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:46:50.207427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.211535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.211799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.213131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.232695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:50.234339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:50.321081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:50.327408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 221/442] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:50.328217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.336298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebf3e-b757-4368-a6ca-fa3582d5b691 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.343600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:50.379937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.380934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.381400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.381812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.382689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=c42940a322704827857570b326a06b8b) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:50.383164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:50.384906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:50.392880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 222/443] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=c42940a322704827857570b326a06b8b&role.id=e748222847a44424b09a5d0be46f4c05 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:50.455696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599e66a-fe34-4071-8026-ac9f01b77e26 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.495157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.495959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.496393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.496918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.512467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:50.517251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:50.518921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:50.521391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 222/444] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:50.525445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.602999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.661145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a9f00-3416-47e0-81ab-5624e3439dbc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.694428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:50.707860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.708933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.709495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.710064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.710792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:50.711199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:50.712683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:50.723844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 223/445] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:50.729580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d453d-2509-4bdc-a678-8882b2abfbae None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.729727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.749725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:50.776937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.777877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.778160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.778429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.790853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:50.796435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:50.797338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:50.798117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 223/446] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:46:50.803997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:50.853960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818dc0f-e3e3-4e27-ba1a-092b0d46be76 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.905863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.907096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.907096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.907096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.936903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96ffa2-0104-4e43-8827-56c4543e8c21 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:50.981298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:50.981833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:50.982108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:50.982371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:50.983144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:50.983498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:50.984925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:50.986483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:50.991671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:50.993126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:50.994819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 224/447] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:51.000583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.008607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:51.111135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d7f3-3782-4dd1-8b75-0305c3dc9493 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.111687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 224/448] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:51.117552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.154371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.154986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.155325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.155599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.222754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:51.223040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5af6d9-b02e-4008-b971-bae6c2843458 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.231701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.233100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.238687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:51.260167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.260798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.261096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.261366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] PATH_INFO: `/v3/projects/0090fa1c947541c19958fa29c1afd1ff` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.262517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] RBAC: Authorizing `identity:get_project(project_id=0090fa1c947541c19958fa29c1afd1ff)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.264101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.265868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 225/449] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:51 2022] GET /identity/v3/projects/0090fa1c947541c19958fa29c1afd1ff => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:51.271224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.343754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 225/450] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:46:51.349616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.374937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346bbeb-acc8-4c8d-9a0d-fd756f0c5c59 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.414478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.415140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.415424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.415698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] PATH_INFO: `/v3/groups/7877118f62ec408fa76c54d08fe5bc93` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.416838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] RBAC: Authorizing `identity:get_group(group_id=7877118f62ec408fa76c54d08fe5bc93)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.418342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.420355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 226/451] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:51 2022] GET /identity/v3/groups/7877118f62ec408fa76c54d08fe5bc93 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:51.425788 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.444567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:51.452928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588d776-f19e-4686-beed-b43f44f54199 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.477254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:51.488785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.489318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.489597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.489865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] PATH_INFO: `/v3/projects/fea01b996ca24de4b927829827bbb0be` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.490964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] RBAC: Authorizing `identity:get_project(project_id=fea01b996ca24de4b927829827bbb0be)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.492553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.494185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 226/452] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:46:51 2022] GET /identity/v3/projects/fea01b996ca24de4b927829827bbb0be => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:51.499730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.535435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a582da3-e021-4c35-b361-be33a448ea89 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.576384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.576992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.577269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.577537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.578270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] RBAC: Adding query filter params (group.id=7877118f62ec408fa76c54d08fe5bc93, role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=0090fa1c947541c19958fa29c1afd1ff) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:51.578574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.580049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.586007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 227/453] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:51 2022] GET /identity/v3/role_assignments?group.id=7877118f62ec408fa76c54d08fe5bc93&scope.project.id=0090fa1c947541c19958fa29c1afd1ff&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:51.606601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe38a29-8698-4fe1-8f15-3ca94d185da6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.646438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dda7a-0d9d-4659-a400-95ebc26f8159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.647100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dda7a-0d9d-4659-a400-95ebc26f8159 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.647390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dda7a-0d9d-4659-a400-95ebc26f8159 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.647667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dda7a-0d9d-4659-a400-95ebc26f8159 None admin] PATH_INFO: `/v3/groups/524de11913414f808228521984948a5c` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.648859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dda7a-0d9d-4659-a400-95ebc26f8159 None admin] RBAC: Authorizing `identity:get_group(group_id=524de11913414f808228521984948a5c)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.650333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dda7a-0d9d-4659-a400-95ebc26f8159 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.652452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 227/454] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Aug 24 09:46:51 2022] GET /identity/v3/groups/524de11913414f808228521984948a5c => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:51.658626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:51.767610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a903558-3c27-468d-af28-172a5b65c07d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:51.781879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:51.802881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:51.803530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:51.803809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:51.804081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:51.804813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] RBAC: Adding query filter params (group.id=524de11913414f808228521984948a5c, role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=fea01b996ca24de4b927829827bbb0be) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:51.805120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:51.806598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86d6e1-1169-47e0-9c40-067a13c7f3c9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:51.812561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 228/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Aug 24 09:46:51 2022] GET /identity/v3/role_assignments?group.id=524de11913414f808228521984948a5c&scope.project.id=fea01b996ca24de4b927829827bbb0be&role.id=e748222847a44424b09a5d0be46f4c05 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:54.547534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960433-f836-4c0d-8e59-97e317929c55 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:54.548278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960433-f836-4c0d-8e59-97e317929c55 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:54.548278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960433-f836-4c0d-8e59-97e317929c55 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:54.551369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 228/456] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:54.561130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00ef4-5f66-405b-9f76-50e0a8a7aa9b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:54.562609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00ef4-5f66-405b-9f76-50e0a8a7aa9b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:54.563483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00ef4-5f66-405b-9f76-50e0a8a7aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:54.596604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9cf00ef4-5f66-405b-9f76-50e0a8a7aa9b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:54.597807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9cf00ef4-5f66-405b-9f76-50e0a8a7aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:54.639594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc050ff6-92ee-4596-9bad-c01b1aca4b2c None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:54.640694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc050ff6-92ee-4596-9bad-c01b1aca4b2c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:54.641906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc050ff6-92ee-4596-9bad-c01b1aca4b2c None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:54.646106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 229/457] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:54.655867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09c042-3970-46cc-aa0a-eaa5b9460dd9 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:54.656777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09c042-3970-46cc-aa0a-eaa5b9460dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:54.657519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09c042-3970-46cc-aa0a-eaa5b9460dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:54.693095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fc09c042-3970-46cc-aa0a-eaa5b9460dd9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:54.695811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fc09c042-3970-46cc-aa0a-eaa5b9460dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:54.751491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:54.778364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 229/458] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:54.835427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 230/459] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:54.954897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073dbc4-6d97-4dcd-b60e-7f9705e7d08e None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:54.955386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073dbc4-6d97-4dcd-b60e-7f9705e7d08e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:54.955532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073dbc4-6d97-4dcd-b60e-7f9705e7d08e None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:54.956836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 230/460] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:54.972873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eba62-da01-4a4d-ab7c-5d8deb6e50be None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:54.973822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eba62-da01-4a4d-ab7c-5d8deb6e50be None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:54.974577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eba62-da01-4a4d-ab7c-5d8deb6e50be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.009738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-299eba62-da01-4a4d-ab7c-5d8deb6e50be None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:55.019076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-299eba62-da01-4a4d-ab7c-5d8deb6e50be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:55.158708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 231/461] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:55.280817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073dbc4-6d97-4dcd-b60e-7f9705e7d08e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:55.306508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ff38-77b8-479a-bcd0-ca2764d73c02 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:55.306954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ff38-77b8-479a-bcd0-ca2764d73c02 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:55.307439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ff38-77b8-479a-bcd0-ca2764d73c02 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.310226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 232/462] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:55.317052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:55.317511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:55.317981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.355093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:55.357131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:55.489646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073dbc4-6d97-4dcd-b60e-7f9705e7d08e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:55.500602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:55.510355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 233/463] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:46:55.511787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:55.530822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:55.531562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:55.531842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:55.532114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.539242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:55.554407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:55.556006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:46:55.586152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:55.588851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:46:55.590743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:46:55.590743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:55.590743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:55.599540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 231/464] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:55.601765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:55.639284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d959faa-20d6-466e-b8f6-87c9b2983c96 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:55.688021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:55.689167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:55.689618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:55.690040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.704281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:55.705931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:46:55.728358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:55.730076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:46:55.731689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:46:55.731689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:55.731689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:55.736284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 234/465] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:55.737042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:55.790481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f42aad-4a64-4d0b-8033-4e8bab88b68d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:55.847345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:55.849476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:55.852119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:55.852451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:55.852731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.870743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:55.873106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:46:55.895852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:55.896997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:46:55.897946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:46:55.897946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:55.897946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:55.897946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 232/466] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:55.899033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:55.905769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343c9b-1a52-407d-9ec5-fdb5d4b0d4b8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:55.925017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:55.964564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:55.965728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:55.966133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:55.966609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:55.967797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:55.968289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:55.970428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:55.995894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 235/467] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:55.995894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.043105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac23b-285a-414c-bbca-84ddf9f42b8e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.084484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.085106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.085403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.085661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.086343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:56.086634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.088117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.100745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 233/468] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:56.101636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.119987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de542f-e748-4121-8b85-dae41ae715e1 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.166430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.167323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.167676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.168051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.170700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.180727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.182229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.186885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-c8f472ef-4cf0-4df8-bbe0-d7335d4f3a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:46:56.198940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:56.200618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 236/469] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7659d-d172-4b8b-a41f-73c2ffaef6f7 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7659d-d172-4b8b-a41f-73c2ffaef6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.202933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7659d-d172-4b8b-a41f-73c2ffaef6f7 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.211024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 237/470] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:56.211024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7659d-d172-4b8b-a41f-73c2ffaef6f7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.228826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbfee6-1954-42ba-b6e2-133eb23ed6e5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.274792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.275464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.275739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.276012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.276711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:56.277075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.278602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.297326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 234/471] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:56.298116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.347882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7659d-d172-4b8b-a41f-73c2ffaef6f7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.385348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.385957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.386391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.386660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.387459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.389020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.412685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 238/472] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:56 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:56.413526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.423656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618f80-3211-420c-ae76-d2113ec10957 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.475589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.480832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.485529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fbb8-e1e5-496c-93b7-799cd5dfc0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.486150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fbb8-e1e5-496c-93b7-799cd5dfc0c0 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.486431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fbb8-e1e5-496c-93b7-799cd5dfc0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.487790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fbb8-e1e5-496c-93b7-799cd5dfc0c0 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.487790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fbb8-e1e5-496c-93b7-799cd5dfc0c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.488973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fbb8-e1e5-496c-93b7-799cd5dfc0c0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.522439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 235/473] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:56 2022] POST /identity/v3/users => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:56.524487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.525075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.525561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.549840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:56.551415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:56.594836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adc65-816a-4ff2-8ee4-6a307a5d341e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.658487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.659456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.659456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.659699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.660381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:56.660690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.662129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.664985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 236/474] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:56.668280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.676977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 239/475] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:56.684545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.820126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddbbb3-b8df-4916-a470-c561953ef66a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.825993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf018c-9ded-491b-9e7d-c25077295716 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.827873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.845291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.870984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.872633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.873085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.873520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.874636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.877345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.888663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.889291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.889566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.889832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.890486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.892423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.916993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 237/476] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:56 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:56.929356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 240/477] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:46:56 2022] POST /identity/v3/users => generated 249 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:57.049871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.221133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59bdae-d43e-4c8f-9ca3-909c122110d9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.260795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.261478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.261753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.262024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.262731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:57.264178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:57.273168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.sql.core [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:46:57.273168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 09:46:57.273168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [parameters: {'id': '5202dd4403834e2a9435d000e3960c73', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 09:46:57.273168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81536) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result.read() Aug 24 09:46:57.289748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:46:57.290675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application yield resource Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise self.value Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application session.commit() Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:46:57.291944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:46:57.292873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:46:57.293736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result.read() Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:46:57.294568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [parameters: {'id': '5202dd4403834e2a9435d000e3960c73', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:57.296533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 09:46:57.298730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:46:57.300706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 238/478] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 09:46:57 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:57.300864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.438729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf246d-f54b-4e87-b824-8a83f7121516 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.494991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41e8d0-7ef0-4a67-90af-a1b700239c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.495979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e8d0-7ef0-4a67-90af-a1b700239c03 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.497459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e8d0-7ef0-4a67-90af-a1b700239c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.497919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e8d0-7ef0-4a67-90af-a1b700239c03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.516912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41e8d0-7ef0-4a67-90af-a1b700239c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-1e41e8d0-7ef0-4a67-90af-a1b700239c03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:57.525144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:57.528486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:57.530813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 241/479] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:46:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:46:57.536275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.615629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:57.674558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651d72d-c704-4252-bae0-2bffa7fdbc2f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.722677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.723352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.723631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.723895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.724587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:57.724899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:57.726485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442018e-c81b-4994-8bec-06202c1bf5d9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:57.737076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 239/480] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:46:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:59.013146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a01bc-5aa7-4c8f-90ed-dfb061b31ad1 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.013888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a01bc-5aa7-4c8f-90ed-dfb061b31ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.013888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a01bc-5aa7-4c8f-90ed-dfb061b31ad1 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.015801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 242/481] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:59.023586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ffd2-1ddf-4c19-a5c6-65b587dc2ad1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.024200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ffd2-1ddf-4c19-a5c6-65b587dc2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.024555 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ffd2-1ddf-4c19-a5c6-65b587dc2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.049478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7803ffd2-1ddf-4c19-a5c6-65b587dc2ad1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:59.050698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7803ffd2-1ddf-4c19-a5c6-65b587dc2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.176165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 240/482] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:59.522206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fbab-c4fe-43d4-9f63-50aa3602e66f None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.522623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fbab-c4fe-43d4-9f63-50aa3602e66f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.522793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fbab-c4fe-43d4-9f63-50aa3602e66f None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.524435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 243/483] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:59.530570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d522012-efef-4780-9a1e-9873d06fbb94 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.530863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d522012-efef-4780-9a1e-9873d06fbb94 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.531139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d522012-efef-4780-9a1e-9873d06fbb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.550805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-5d522012-efef-4780-9a1e-9873d06fbb94 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:59.556229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5d522012-efef-4780-9a1e-9873d06fbb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.593681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:59.677034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 241/484] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:59.691565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fbab-c4fe-43d4-9f63-50aa3602e66f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:59.726791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:59.837491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885393-d4d0-43c0-9420-b591753a2e7d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.837853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885393-d4d0-43c0-9420-b591753a2e7d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.838076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00885393-d4d0-43c0-9420-b591753a2e7d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.839976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 242/485] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:59.849548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee06f-8e6e-4020-a06b-e28c2dd3651f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.850021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee06f-8e6e-4020-a06b-e28c2dd3651f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.850521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee06f-8e6e-4020-a06b-e28c2dd3651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.877955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fbab-c4fe-43d4-9f63-50aa3602e66f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:59.899132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-16fee06f-8e6e-4020-a06b-e28c2dd3651f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:59.900707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-16fee06f-8e6e-4020-a06b-e28c2dd3651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.948318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:59.949096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.949409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.949647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.978117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:46:59.986087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:46:59.986976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:46:59.987820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:46:59.988454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 244/486] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:00.002932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.027338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 243/487] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:00.029370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf607a-e3b2-4c7f-8299-39695871c30d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.029937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf607a-e3b2-4c7f-8299-39695871c30d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.030406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf607a-e3b2-4c7f-8299-39695871c30d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.032111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 244/488] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:00.043262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.044486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.048359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.077142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:00.078345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:00.167654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.181242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 245/489] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:00.182963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.190058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ea31-0787-477a-8bad-4bf6be6ea98d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.216396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.234911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.236017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.236297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.236570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.237523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:00.237832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.239266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.249578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 245/490] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:00.260014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.400895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380aef5-90a6-449e-a3f4-e72e354f0f3c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.443022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.443600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.443878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.444146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.455392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:00.460046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:00.463212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 246/491] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:00.466354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.475719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1584-9a4c-4e98-999f-1f6466ee0a70 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.518743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.519788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.520263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.520708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.538655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.542301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.544024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:00.563803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:00.564778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:00.565602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:00.565602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:00.565602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:00.566634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 246/492] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:00.567078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.574265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.598586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd03d-c81a-4168-a1bc-defd5989a21d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.641255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.641908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.642304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.642586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.657081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:00.662821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:00.664528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 247/493] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:00.665905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.722041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256e922-bde4-4fa2-af4d-9301d65fb946 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.781602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.782751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.783130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.783411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.784543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:00.785066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.787252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.797187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 247/494] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:00.798209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.843167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57494496-d3d6-4203-9481-d334bf55857e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.859340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.881975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.882600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.882874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.883179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.891553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.897916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:00.903891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:00.904827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:00.905598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 248/495] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:00.906278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.927959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b4947-b793-41f7-bbff-1e137028e09e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.979206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.979737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.980017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.980321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.980972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:00.981275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.982669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.995428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 248/496] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:00.996338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.049256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a2977-5602-464e-9f9e-ad43ee45d5d6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.089459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.090097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.090455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.090733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.091446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:01.091744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.093149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a44189-3d33-4cfc-8afa-3d56a2cd7941 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.101700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 249/497] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:01.106768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916d50-0701-46a8-b1d1-8ac8a4619818 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.106768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916d50-0701-46a8-b1d1-8ac8a4619818 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.106768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916d50-0701-46a8-b1d1-8ac8a4619818 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.106768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 250/498] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:01.106768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31916d50-0701-46a8-b1d1-8ac8a4619818 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.131090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3351-f92a-45a0-9ccf-3b94d67405b9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.155726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.186748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.187774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.188224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.188665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.194356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.206523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.208055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:01.228787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:01.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:01.232625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:01.232625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:01.232625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:01.232625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 249/499] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:01.232625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.243650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31916d50-0701-46a8-b1d1-8ac8a4619818 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.292281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.293051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.293693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.293693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.294329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:01.294626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.296060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.309491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 251/500] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:01.310333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.373984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ce4f-47ad-4d21-9b8f-ae2c5b277b66 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.408956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.409578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.409852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.410125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.417909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.419432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.427431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ae653-e298-43a2-a329-c5668ec8891d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-11b74860-2a57-4766-8063-bceda2280e87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:01.431825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:01.433329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:47:01.434364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:01.438079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 250/501] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:01.439273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.439561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.439839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.459458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.465103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:01.466344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:01.473103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.474153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.474493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.474891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.487845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.490301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.492556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:01.511541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:01.512848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:01.513900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:01.513900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:01.513900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:01.517647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 252/502] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:01.519279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.548862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 251/503] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:01.549729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.643810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efefae-4008-4210-8de0-b1764d862374 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.674686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a6075-198e-4603-b441-0af3419f0877 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.688331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.689306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.689780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.690249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.691440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:01.691942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.694399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.712601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 253/504] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:01.713288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.722540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.724022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.724527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.724989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.737385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.739032 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.755263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:01.758445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:01.759365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:01.767422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:01.767422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:01.767422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:01.767422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 252/505] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:01.767422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.780192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.883909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70641d5e-c368-4ddf-85b8-945c4c7a95d5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.890687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a85d7a-94df-45b6-bff8-3328363792ba None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.932953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.933618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.933897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.934168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.934640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.934921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:01.935580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.935697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.935829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.936198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.937181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:01.937630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.938069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.939513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.953758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 253/506] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:01.954677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.989302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 254/507] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:01.990051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.054133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.101375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.102501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025ae2c-5e3e-4a2d-b185-2ebdefb52661 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.118641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2f184-c532-4eec-b2a7-356eb9d2f702 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.144822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.145685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.146114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.146613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.159239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.161359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.162825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.163494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.163813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.164092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.164759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:02.165079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.166617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.179746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 255/508] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:02.180601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:02.182034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:02.184147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 254/509] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:02.186257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.304859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bffc7-10cf-4ea7-9fc3-194ff3bb3e6e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.323417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e86cb-e0c3-4abc-8b5c-46bd5534b32c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.342188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.342825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.343133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.343406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.356683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.357627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.358565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.367725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.368462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.368790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.369118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:02.375091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:02.376136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:02.377039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:02.377039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:02.377039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:02.377039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 256/510] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:02.377039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.379498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.380962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.389380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:02.399706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:02.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:02.403028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 255/511] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:02.404290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.514547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38ef7-ee76-415f-898b-1cf6cd20565f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.534385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f59f1-678a-4bfe-8b24-890677ef7abb None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.549757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.550368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.550646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.550915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.570763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.571445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.571721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.571990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.581228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.581621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:02.594038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:02.595277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 256/512] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:02.596298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.646507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.648031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.659195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.686190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.748094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13770c3a-109f-4fce-be83-c4eccca5db07 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.784475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 257/513] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:02.785482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.797647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.798261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.798539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.798812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.799594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:02.799895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.801351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.850249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 257/514] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:02.851075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.911789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ac606-66e2-426d-a99c-08355fb0c632 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.920068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.957285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.957904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.958306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.958472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.959161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:02.959467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.960971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.973128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 258/515] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:02.973981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.982109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb7af-41cf-4e49-ba0c-19afccda4c3f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.989984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.025798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.026418 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.026694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.026962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.028596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:03.028596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.029647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.055322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 258/516] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:03.056433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:03.104856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e101-12e6-4727-afdf-092f1168ebd4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.140202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.140819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.141095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.141365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.142118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:03.142418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.143931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.169587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 259/517] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:03.170448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:03.196215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3bb1-e0aa-4b86-bdc5-786f1327d56b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.199036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.249697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.250335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.250613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.250882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.263570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.266120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.283864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d990-aca6-4846-9794-549a49b93c19 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:03.284223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:03.286078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:03.287902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:03.287902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:03.287902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:03.287902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 259/518] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:03.287902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:03.309584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.328033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.328642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.328918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.329185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.402390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f60bd-f7bd-43f8-a588-4864253428ac None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.416340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.418628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.440819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.441462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.441739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.442006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.442648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.444140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.448102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.468742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 260/519] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:47:03 2022] POST /identity/v3/users => generated 247 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:03.469832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:03.567618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 260/520] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:03.568803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:03.583829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.624714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a32b3-c72c-45a6-9b21-824a0f9e3392 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.682486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.683324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.683726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.684148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.721940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ed1d-bf94-475f-a37c-4229af634bcd None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.749989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.762447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.763084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.763372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.763643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.785552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.787242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.858274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.860306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.907672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:03.949057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 261/521] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:03.950036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.022972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 261/522] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:04.022972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.057642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.102704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc338-2cd7-4368-9ca7-3587ff22e53a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.141485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.142387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.142814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.143039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.143604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:04.143954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.146190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.163252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 262/523] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:04.164437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.184836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774987-d2b2-4317-86ca-7ff5f5d1b027 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.230281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.233512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.234170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.234449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.234775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.252597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.254103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:04.275658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:04.276849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:04.278575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:04.278575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:04.278575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:04.278575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 262/524] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:04.278575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.358896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd0450-051e-4cd1-8ed6-c6bfd8f68402 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.378467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.420787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.421442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.421718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.421988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.426012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f55ce-d503-4e7d-b073-791ccdeab99f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.441243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.443812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:04.467775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:04.469097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:04.470372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:04.470372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:04.470372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:04.470372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 263/525] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:04.470372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.492327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.493137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.493609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.494033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.508834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.510380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:04.526839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:04.527887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:04.528852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:04.528852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:04.528852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:04.528852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 263/526] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:04.529074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.596943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.623120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf9bd6-06fb-4049-bd19-5ddef39cb63d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.668758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b6c83-ec8b-440d-b9fc-d42cd0df4dc1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.681195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.681876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.682548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.682836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.692592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.694066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.703722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:04.709334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:04.710278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:04.711163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:04.711621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 264/527] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:04.712833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.721809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.722311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.722590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.722917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.723660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:04.724165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.726263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.746564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 264/528] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:04.748144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.850866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240595-78d4-4cc8-833d-52d96d1f6ecd None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.894676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.895332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.895605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.895884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.896665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:04.896971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.898369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.904943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13b017-b98d-460d-b064-2f2669df3ef2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.923161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 265/529] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:04.923161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.926401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.950905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.951661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.951949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.952283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.952969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:04.953322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.954811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.973522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 265/530] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:04.974334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.055067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:05.094269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da692987-3d1a-4b3d-92e7-0cf289107099 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.139926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7be40-05c8-49cc-9420-440b02ece07c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.158606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.159810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.160209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.160584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.161820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:05.162440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.165035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.192195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44839515-364f-42c0-a014-27d105e04916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.193204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44839515-364f-42c0-a014-27d105e04916 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.193862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44839515-364f-42c0-a014-27d105e04916 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.194003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 266/531] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:05.195169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.198779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44839515-364f-42c0-a014-27d105e04916 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.218643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44839515-364f-42c0-a014-27d105e04916 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.220834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44839515-364f-42c0-a014-27d105e04916 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-44839515-364f-42c0-a014-27d105e04916 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:05.238030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:05.239181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 266/532] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:05.240204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44839515-364f-42c0-a014-27d105e04916 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.301863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:05.358319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c505c-3f4f-4aa6-b113-4306f783ea4a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.395628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44839515-364f-42c0-a014-27d105e04916 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.407200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.408116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:05.408468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.408759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.409035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.418376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.419997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:05.432827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:05.434283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 267/533] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:05.436242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.459376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.460292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.460895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.461100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.473977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.475506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:05.488399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:05.489540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 267/534] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:05.490689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.604515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdac9b-3479-41f1-ab82-579791b545b4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.630844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebfae7-b517-4a98-a65a-2141fc90a66e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.647956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:05.668348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.668998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.669221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.669499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.670249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=c0a103b9b799406fab32d0eaa4965592) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:05.670539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.672037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.678661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 268/535] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/role_assignments?user.id=c0a103b9b799406fab32d0eaa4965592&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:05.680247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.691545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.692298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.692592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.692872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.693744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:05.694281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.696315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.730631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 268/536] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:05.730631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.791540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:05.878493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15650ce-9a3d-4ecd-a8c2-22d7c6638cdc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.914415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa3c30-7aa7-4161-9b92-7f0fb9de85c9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:05.934558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.935215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.935551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.936031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.936794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:05.937100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.938585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bdc7f-50f8-4ad9-abe2-67cb8d63d454 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:05.960015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 269/537] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:05.960015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c7c7-78ba-430a-9d9d-a2cc25f7afd5 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.960015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c7c7-78ba-430a-9d9d-a2cc25f7afd5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.960015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4c7c7-78ba-430a-9d9d-a2cc25f7afd5 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.960015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 270/538] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:05.960015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4c7c7-78ba-430a-9d9d-a2cc25f7afd5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:05.978935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:05.979717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:05.980114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:05.980267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:05.981064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:05.981654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:05.983675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:06.004380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 269/539] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:06.004380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:06.048116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:06.120597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:06.133397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4c7c7-78ba-430a-9d9d-a2cc25f7afd5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:06.143038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09732fe0-f63b-44d8-b34e-77ba4a4ec71f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:06.184851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:06.185471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:06.185754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:06.186062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:06.186769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=28f32f08ac32498ba75eb4faa022f464) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:06.187136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:06.188620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3df46-ecd9-43b5-99af-20801125cad8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:06.194749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:06.196022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:06.196616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:06.197066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:06.198296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=e8980803eace443d849c22a6e0781894) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:06.198779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:06.200646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:06.203100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 271/540] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/role_assignments?user.id=28f32f08ac32498ba75eb4faa022f464&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:06.204677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:06.205171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:06.205651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:06.221787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 270/541] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:05 2022] GET /identity/v3/role_assignments?user.id=e8980803eace443d849c22a6e0781894&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:06.222455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:06.241663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:06.244388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:06.371923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 272/542] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:06.495042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705048a6-3b1d-4f6d-a5f5-8eab0a4be2cd None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:06.549510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:06.550470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:06.550886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:06.551307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:06.552382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=fc76f59ac1054c18a5e03cc0a18db502) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:06.552818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:06.554681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:06.563364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 271/543] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:06 2022] GET /identity/v3/role_assignments?user.id=fc76f59ac1054c18a5e03cc0a18db502&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:06.827106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:06.930804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:07.021893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b164d8d-eafd-4977-8573-a2b03a529e59 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:07.063430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:07.064079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:07.064358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:07.064633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:07.078143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:07.088329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:07.089300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:07.090141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:07.090754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 273/544] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:07.098187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:07.146927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:07.334973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26622b8-5a0e-4b73-a27e-90690e013343 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:07.429136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:07.429767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:07.430047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:07.430319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:07.432841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:07.432841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:07.435643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:07.466434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 272/545] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:07.472894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:07.666018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052a89-1812-46e0-b890-773fb57f5c2a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:07.671538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:07.719638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:07.720290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:07.720570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:07.720840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:07.738112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:07.742296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-9d1a41d2-2300-4f72-9663-3d83b77d5a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:07.770389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:07.771375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:07.772226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:07.772226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:07.772226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:07.772226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 274/546] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:07.780839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:07.957397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:07.996962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9358d-3525-464f-9722-4bfe4f6f44dc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:08.055546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937fb5-c302-4203-8098-b533b4f97a8d None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:08.055799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937fb5-c302-4203-8098-b533b4f97a8d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:08.056104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937fb5-c302-4203-8098-b533b4f97a8d None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:08.058879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 275/547] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:08.064357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:08.064851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:08.065264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:08.080880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:08.081529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:08.081817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:08.082091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:08.082765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:08.083088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:08.084539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:08.103807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:08.105823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:08.117378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 273/548] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:08.123742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:08.312285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2963b2-09c1-4d40-8084-279d01ba638a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:08.349376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 276/549] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:08.375817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:08.376638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:08.376805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:08.377173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:08.394381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:08.395893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:08.405141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:08.420424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:08.422865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:08.424814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:08.431091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 274/550] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:08.440247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:08.616855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:08.660080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5682033-f9e2-4421-8ae1-4efe45bb1a20 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:08.712458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:08.713085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:08.713417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:08.713701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:08.714450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:08.714782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:08.716412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:08.747128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 277/551] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 09:47:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:08.753590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:08.769904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:08.949765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9dc29-231e-4611-9930-217c1aa94e7c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:09.007984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a425e-a417-45b3-8436-455b17d21a5c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:09.010354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044281eb-59ec-4e2e-930c-a6ac7d5cea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:09.011010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044281eb-59ec-4e2e-930c-a6ac7d5cea59 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.011324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044281eb-59ec-4e2e-930c-a6ac7d5cea59 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.011602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044281eb-59ec-4e2e-930c-a6ac7d5cea59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.059476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:09.060471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.060760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.061019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.081976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:09.090840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:09.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:09.094275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:09.099895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 278/552] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:09.102797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:09.111601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:09.234178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:09.241469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044281eb-59ec-4e2e-930c-a6ac7d5cea59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:09.244653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044281eb-59ec-4e2e-930c-a6ac7d5cea59 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:09.257771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c6b5-d94d-4249-8561-7137589b9b5c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:09.329948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:09.331001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.331438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.331849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.332766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:09.333157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:09.334993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757b46b-1524-438f-86d4-90f88d630ded None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:09.350016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 279/553] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:09.352331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64fa88-e646-48f1-a124-e60f0db3345e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.352938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64fa88-e646-48f1-a124-e60f0db3345e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.353534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64fa88-e646-48f1-a124-e60f0db3345e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.359217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 280/554] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:09.361529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c071455-b0f4-406f-bce9-e19cfc29574b None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.361953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c071455-b0f4-406f-bce9-e19cfc29574b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.362347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c071455-b0f4-406f-bce9-e19cfc29574b None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.364843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 281/555] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:09.365926 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c071455-b0f4-406f-bce9-e19cfc29574b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:09.428736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 275/556] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:09.431199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654b08f-c35a-49c7-99e4-384b9d5f0a62 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.432292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654b08f-c35a-49c7-99e4-384b9d5f0a62 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.433199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654b08f-c35a-49c7-99e4-384b9d5f0a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.458139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9654b08f-c35a-49c7-99e4-384b9d5f0a62 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:09.459602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9654b08f-c35a-49c7-99e4-384b9d5f0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:09.463765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:09.535999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c071455-b0f4-406f-bce9-e19cfc29574b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:09.568775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 276/557] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:09.570659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b0c0a-d6c6-4704-9029-65e74f4f129e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.571081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b0c0a-d6c6-4704-9029-65e74f4f129e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.571584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b0c0a-d6c6-4704-9029-65e74f4f129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.605970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-fe8b0c0a-d6c6-4704-9029-65e74f4f129e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:09.607912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-fe8b0c0a-d6c6-4704-9029-65e74f4f129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:09.609886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:09.611178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.611825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.612435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.641621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:09.645061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:09.651909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:09.678075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:09.679297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:09.680197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:09.680197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:09.680197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:09.683192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 282/558] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:09.684675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:09.706152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 277/559] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:09.707460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c08bb0-184c-46ab-a6a3-5b7cfb9b1bbf None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.707758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c08bb0-184c-46ab-a6a3-5b7cfb9b1bbf None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.708009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c08bb0-184c-46ab-a6a3-5b7cfb9b1bbf None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.711224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 278/560] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:09.715570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c08bb0-184c-46ab-a6a3-5b7cfb9b1bbf None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:09.851315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e651e-e96b-4887-abc2-3b9ed6e9aa37 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:09.871699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:09.892837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c08bb0-184c-46ab-a6a3-5b7cfb9b1bbf None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:09.900094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:09.900761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.901287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.901287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.925399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:09.926877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:09.939793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:09.940769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.941243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.941685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-732c6a4e-7e6d-4e2d-950a-2074af9e93fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:09.942447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:09.943398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:09.944265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:09.944265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:09.944265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:09.944445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:09.944445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:09.944580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 283/561] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:09.945109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:09.945336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:09.945742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:09.948930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:09.963666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 279/562] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:09.964785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:09.966047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:09.967561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:09.988273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.049861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 284/563] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:10.051020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.091153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511e3ca-c2c2-4a63-a1f6-8181f53b9fbc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.141698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.142373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.142656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.142934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.158206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:10.163875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:10.164869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 280/564] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:10.168099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.176303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.180310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de7d1-365a-4a09-91f0-01950ad1164f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.235112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.235696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.236422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.236422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.237053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:10.237356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.238850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:10.257539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 285/565] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:10.257539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.288256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.326869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5ec5-26f2-447e-8b31-53755441aba5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.366212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.366852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.367179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.367453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.376251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.378048 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:10.379730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341407c7-de39-4c52-b1f0-12dbf16b7659 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:10.390851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:10.392908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 281/566] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:10.393832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.423565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.424306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.424581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.424858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.437711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:10.442923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:10.443901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:10.444731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 286/567] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:10.445537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.467406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.510126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e374f-aa32-44f2-a63e-8595fb30d45b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.551583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.552206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.552483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.552750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.553433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:10.553738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.555155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:10.557559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fda6b-187f-40d0-93ba-6c06ff40a085 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.562399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.564980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 282/568] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:10.565686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.607636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.608297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.608568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.608839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.617327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.618949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:10.632149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:10.633122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:10.634015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 287/569] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:10.634482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.691700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe923-a744-44e7-a5be-df586e6f65d9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.719331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.730520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.731247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.731526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.731797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.744701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:10.748842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415713-555a-488f-a554-4edf0cc04a58 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:10.750015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:10.750907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:10.751920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 283/570] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:10.752733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.790397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.790929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.791247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.791520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.792256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:10.792658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.794403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:10.820484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 288/571] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:10.821969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.825726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.879632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43995c-4318-441b-b717-1204c71a9c19 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.922339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.923037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.923428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.923775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.924705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:10.925085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.926560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:10.936818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 284/572] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:10.937973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.940986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a5123-6c1f-4645-b77a-123dacd9a8f5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.980765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.981449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.981705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.981999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.985188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.996683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.998013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:11.013968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:11.015009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:11.016599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:11.016599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.016599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:11.016599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 289/573] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:11.016599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.056983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278d35f-f195-4af2-931e-d226f57f691c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.084022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.096683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.097294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.097572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.097847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.098544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:11.098844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.100334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.113945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 285/574] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:11.114788 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.138242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a012-64ac-431e-a379-f603a42d2093 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.177253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.178191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.178632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.179081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.180149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:11.180616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.182999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.194269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 290/575] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:11.196187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.235852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f6f1-a424-4ca2-9694-82f98ef4ed01 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.251315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.272159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.272833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.273137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.273415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.285043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.286534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:11.304025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:11.305070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:11.305965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:11.305965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.305965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:11.305965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 286/576] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:11.305965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.306708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704a7f3-146f-46e1-b356-cd5bae9c21f5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.343664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.345530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.346157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.346433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.346699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.358554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.360059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:11.378956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:11.379999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:11.380873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:11.380873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.380873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:11.380873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 291/577] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:11.381095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.421931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cda330-0015-4fb8-8d4e-f3a8dccc5528 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.466562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.467195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.467471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.467736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.468697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:11.468697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.470054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.482561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 287/578] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:11.483422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.516259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c3fcf-77d0-4193-a4af-b18857ee0710 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.518142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.556277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.557025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.557376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.557713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.558522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=3592ce2e44b3470b8a5299295364031d) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:11.558927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.560555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.566785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 292/579] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/role_assignments?user.id=3592ce2e44b3470b8a5299295364031d&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:11.567484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.616784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.627086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa80365-58b3-4f55-8552-3e2544a0c104 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.672888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.674705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.674705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.674705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.690082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.692369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.714569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fa922-0d5c-4b60-bc70-f5cd781553f1 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:11.719576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:11.720569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:11.721443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:11.721443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:11.721443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:11.721443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 288/580] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:11.721692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.759183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.759998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.760340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.760671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.761326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:11.761640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.763353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.777868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 293/581] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:11.778709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.811185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.848303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26974-cfcc-4748-aa81-d0f4ffd90049 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.899751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.900292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.900575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.900866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.901372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c473a93-0796-4916-b56b-98cf650bcc3f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.901502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:11.901832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.903698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.916816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 289/582] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:11.917547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.926845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.949801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.950689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.951014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.951319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.960639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.962603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:11.976859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:11.977876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:11.978831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:11.983469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 294/583] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:11.984286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.033861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06bf1-d756-49a5-949a-1e2673ba0823 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.078417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309194d0-687f-42e2-8849-d5768437663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.079395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309194d0-687f-42e2-8849-d5768437663a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.079858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309194d0-687f-42e2-8849-d5768437663a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.080232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309194d0-687f-42e2-8849-d5768437663a None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.081142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309194d0-687f-42e2-8849-d5768437663a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:12.081651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309194d0-687f-42e2-8849-d5768437663a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.083839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309194d0-687f-42e2-8849-d5768437663a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.090606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:12.107226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585d87-bb5d-41fa-8bde-d4fc11eca7bf None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.112889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 290/584] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:12.112889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309194d0-687f-42e2-8849-d5768437663a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.165030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.165325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.166188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.166188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.174019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.175469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:12.188221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:12.189907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 295/585] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:12.191683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.219801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:12.266629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309194d0-687f-42e2-8849-d5768437663a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.307801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.308819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.309099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.309373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.318154 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.320123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.325940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b1d99-1caa-4476-b14e-98897dcb40af None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:12.334513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:12.335802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 291/586] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:12.337479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.370469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.371108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.371567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.371948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.372814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:12.373120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.374570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.403932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 296/587] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:12.404931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.408852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:12.464773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d3509-f71b-49fa-af6a-8a73fabe73fb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.493306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:12.503676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.504327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.504600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.505238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.514441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.516400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:12.529316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:12.530299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 292/588] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:12.531256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.539273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a7ce6-495c-449e-a400-2f19b24f9a8e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.589109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.589788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.590148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.590430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.591392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:12.591713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.593242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.611812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 297/589] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:12.611812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.672003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedb7fe-11fe-40d0-89f3-38778be466c1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.697332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:12.721034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.721798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.721798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.722053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.722791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:12.723125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.724550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.743370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 293/590] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:12.744378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.763236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0363e6-a551-4b48-9f9a-31fb743fabd0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.797848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:12.808451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.809349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.810200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.810512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.824426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.826325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:12.857989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:12.859241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:12.860225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:12.860225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:12.860225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:12.866545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 298/591] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:12.867792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.885298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ced19-5e4e-479c-9e5c-a64db0ba4bcb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:12.938155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:12.939720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:12.940166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:12.940608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:12.941888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:12.942359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:12.944857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:12.969956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 294/592] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:12.971126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:12.996274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfed65d-4af3-4c55-b163-0c7829c98232 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.018374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:13.047856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.049488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.049963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.050390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/c0a103b9b799406fab32d0eaa4965592/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.074327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=c0a103b9b799406fab32d0eaa4965592, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.076261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.093255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 299/593] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:12 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/c0a103b9b799406fab32d0eaa4965592/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:13.094467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.126151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c702-8164-4959-bb15-df8923f7e1b7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.134566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:13.212616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.213661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.214214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.214718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.237033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.240087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:13.271072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:13.272381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:13.273275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:13.273275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:13.273275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:13.287698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 295/594] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:13.290684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.325447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365da8-ee6c-443f-b8d7-5747fbd552ed None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.381310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.382431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.383039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.383405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.384296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:13.384712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.387221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.407096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 300/595] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:13.408091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.453256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:13.473489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638dbc0-349a-4b7d-b015-548cb29ca368 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.511193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.512086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.512381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.512625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.524561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.526042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:13.541845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:13.543096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:13.544090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:13.544090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:13.544090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:13.544090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 296/596] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:13.544945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.555527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:13.557055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39c080-1414-4f72-8f3d-bc16d9769ebc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.596209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.597212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.597715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.598246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.599187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:13.599717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.601332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.614964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 301/597] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:13.620238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.670580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19cee-d6d3-497b-a513-b0387b994571 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.722908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.724111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.724585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.725029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.730009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:13.739595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.741810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.746687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14ffe-3f99-443f-b4eb-6cf21039786f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f06fa70a-90a2-4711-aced-7d06bbfba512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:13.759686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:13.760715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:13.761636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 297/598] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:13.767095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce6a16-85c8-4254-a33b-70f0a6a670af None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.767506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce6a16-85c8-4254-a33b-70f0a6a670af None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.767793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce6a16-85c8-4254-a33b-70f0a6a670af None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.775683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 298/599] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:13.776704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce6a16-85c8-4254-a33b-70f0a6a670af None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.797480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.802384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.802384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.802384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.802384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:13.802384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.802384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.821143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 302/600] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:13.821143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.871563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:13.919631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce6a16-85c8-4254-a33b-70f0a6a670af None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.944218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1fb1-6c58-4733-9a6b-2beaf76484e0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:13.957080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.957715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.958104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.958376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.967205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.968898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.979715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:13.980334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.980617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.980902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-d70bdb88-dfc7-43ac-a93c-e79eb8e97cfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:13.981774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:13.982653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:13.983570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:13.983989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:13.983989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:13.984119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:13.987890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 299/601] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:13.989245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.989510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.989815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.997988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 303/602] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:13.998889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.007976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:14.016757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:14.017920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:14.097334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 300/603] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:14.098488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.125226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7cc4-63c1-45fe-a247-fc9009520b08 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.164392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.164972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.165253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.165529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.173606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.175084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:14.188563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:14.189511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:14.190432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 304/604] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:14.190914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.199231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:14.256361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa6bf-9892-48fd-8de1-55628f2eb0a6 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.282867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:14.298817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.299626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.300001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.300371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.301250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:14.301936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.303692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.322796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 301/605] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:14.322796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.337673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57c9cc-118a-4ef4-a40e-3e9f1cc301ff None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.385096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.386278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.386703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.387200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/28f32f08ac32498ba75eb4faa022f464/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.406014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=28f32f08ac32498ba75eb4faa022f464, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.407499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.422542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 305/606] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:14 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/28f32f08ac32498ba75eb4faa022f464/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:14.423375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.441331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683df7-b3f4-496a-af20-f2f3433cadb4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.463248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:14.487297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.488358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.488837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.489348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.490443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:14.490975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.492747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.508344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 302/607] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:14.520458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.569639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c6262-0763-4ab1-a840-7a2413cb1719 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.589850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:14.616695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.617536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.617656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.617902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/e8980803eace443d849c22a6e0781894/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.639607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=e8980803eace443d849c22a6e0781894, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.641090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.652012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98bbf1-891b-4efc-ac53-49dfec745e6e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.664484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 306/608] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:14 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/e8980803eace443d849c22a6e0781894/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:14.666758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.725623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.727333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.728027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.728512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.750026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:14.761943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:14.763019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:14.764005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:14.771600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 303/609] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:14.773165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:14.806437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d30f5-3201-41f8-a949-551ccbd2d930 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.825880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:14.851619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.852587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.853046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.853479 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/fc76f59ac1054c18a5e03cc0a18db502/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.872831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=fc76f59ac1054c18a5e03cc0a18db502, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.874576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.892037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 307/610] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:14 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/fc76f59ac1054c18a5e03cc0a18db502/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:14.908781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1dc8f-7f72-4972-a09b-a3b92b470e1b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.956841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.957926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.958369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.958853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.959784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:14.960261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.961961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.973512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 304/611] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:14.978946 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:15.003772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:15.105256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55335e6-5d4c-4dbb-ab1a-71c1f23a1f0b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:15.144379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:15.145085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:15.145374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:15.145645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:15.158282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:15.159922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-041d9d1a-5f84-44aa-8c20-20b13e1b2827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:15.177080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:15.178095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:15.179563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:15.179563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:15.179563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:15.179563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 308/612] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:15.184068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:15.338639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3dbfe-f943-4eab-9bb0-3abcc54b0459 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:15.339408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3dbfe-f943-4eab-9bb0-3abcc54b0459 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:15.339689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3dbfe-f943-4eab-9bb0-3abcc54b0459 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:15.341395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 309/613] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:15.347368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:15.347750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:15.347912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:15.360727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:15.366327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543f12b-e793-4d74-a78d-96b3a0dc126d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:15.383265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:15.384480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:15.408544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:15.409789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:15.410080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:15.410356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:15.411144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:15.411456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:15.413070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:15.428278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 305/614] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:15.435361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:15.555191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:15.570909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 310/615] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:15.603337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0c833-aa7d-4b6d-a563-2eabba446767 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:15.654675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:15.655282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:15.655552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:15.655822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:15.671870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:15.673343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:15.691108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:15.692116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:15.693539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 306/616] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:15.700320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:15.882774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f1ff-4c9d-400c-a8d6-6879fc18921d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:15.940938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:15.941931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:15.942413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:15.942892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:15.944073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:15.944595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:15.946318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:15.973639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 311/617] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 09:47:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:15.983370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.020947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.024540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.125717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d5e04-99ff-47b8-98e5-7b135512b08c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.180570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.198142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.199104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.199396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.199739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.229628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.231482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.260800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab203b-e941-4b27-ae1f-34007885b18d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:16.267847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:16.269074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:16.270063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:16.270063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:16.270063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:16.276714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 307/618] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:16.284148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.316902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.318329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.318759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.319220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.342314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:16.349814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:16.350758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:16.351765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:16.355544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 312/619] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:16.362748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.449187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.523869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b898-83d5-47bc-b42b-a79e7a5050f0 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.564338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.565473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.565901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.566315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.567145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:16.567599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.569784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.577770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305991a0-7e68-4273-8d46-390f2c629e96 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.584988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 308/620] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:16.591281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.635424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.717041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf002c-ceb3-4bf6-8197-f7ba2b420722 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.723913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.724579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.724906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.725178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.725866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:16.726167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.727697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.743407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 313/621] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:16.750929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.771626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.786104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.786754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.787061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.787324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.802559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.804076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:16.825965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:16.827001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:16.827911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:16.829670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 309/622] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:16.838608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.916603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59756e1d-0b5f-4966-a7d3-bd2e618e3602 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.957019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.958096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.958597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.959147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.974444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.976656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3498ed05-8656-42b1-a106-1b003ba645c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:16.993559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:16.994584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:16.995510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:16.995510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:16.995510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:16.995731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1214b5-3baf-49f9-8e56-41d8d98730af None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.998028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 314/623] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:16.999543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ceb28-d66e-4399-a5e6-6ab05fd75ba8 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.999979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ceb28-d66e-4399-a5e6-6ab05fd75ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.000409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ceb28-d66e-4399-a5e6-6ab05fd75ba8 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.006058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 315/624] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:17.007136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ceb28-d66e-4399-a5e6-6ab05fd75ba8 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.035141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.035957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.036334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.036701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.037508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:17.037912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.039760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7e5b0-9398-4f93-b36a-5ebbfdce762c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.041736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.058676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 310/625] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:17.058676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.058676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.058676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.075416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.076891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.127183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ceb28-d66e-4399-a5e6-6ab05fd75ba8 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.128832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.156421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 311/626] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:17.157262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.169477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.170092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.170372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.170645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.171332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:17.171644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.173034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08daf6f-db84-4a56-9984-cd683e96a9e3 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.187334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 316/627] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:17.188706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d12b-a59f-4e9d-af70-276221f12202 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.188993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d12b-a59f-4e9d-af70-276221f12202 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.189267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d12b-a59f-4e9d-af70-276221f12202 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.191022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 317/628] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:17.196785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.197113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.197330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.221777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.222999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.308799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500631-146d-4ee4-a20f-10ec60508d93 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.315666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 318/629] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:17.316672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.346998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.353126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b36c5-24f8-47bc-9ec1-77e82b164155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.354262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b36c5-24f8-47bc-9ec1-77e82b164155 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.354763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b36c5-24f8-47bc-9ec1-77e82b164155 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.355385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b36c5-24f8-47bc-9ec1-77e82b164155 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/3592ce2e44b3470b8a5299295364031d/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.372168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b36c5-24f8-47bc-9ec1-77e82b164155 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=3592ce2e44b3470b8a5299295364031d, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.374145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b36c5-24f8-47bc-9ec1-77e82b164155 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.400499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 312/630] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:17 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/3592ce2e44b3470b8a5299295364031d/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:17.400499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae02c8-a02d-4624-859a-d7939efa4ea2 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.400499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae02c8-a02d-4624-859a-d7939efa4ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.400499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae02c8-a02d-4624-859a-d7939efa4ea2 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.400499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 313/631] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:17.405921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.406253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.407523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.448593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.452169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.507002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.514709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd57c91-6cd8-43aa-a661-6b76598e1e1a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.563833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.564787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.565141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.565476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.576565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.577162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 314/632] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:47:17.578219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.580630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:17.594758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:17.595827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:17.596746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 319/633] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:17.603491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.721205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f927a-8d04-408a-abd7-1e4ab016a783 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.742050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.766601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ea98d-74c9-40d0-8350-9e9326058c2a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.767526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.768169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.768442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.768953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.783579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:17.791084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:17.792892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 315/634] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:17.794534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.814808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.815550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.815962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.816327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.817168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:17.817691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.819257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.823323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.843231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 320/635] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:17.844310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.916859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacae5e-cdbc-4b7f-9c73-a2c378976300 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.953202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.954112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.954112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.954401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.960248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81749b0f-3d53-4605-9119-5a253008f3cd None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.966184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:17.970824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:17.971935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 316/636] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:17.972894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.013631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.014544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.014831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.016023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.016700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:18.017002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.018386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.024929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.036236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 321/637] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:18.037315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.073573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.098703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caad3a-9ca4-47ec-8d18-663ffd77abd8 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.137875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.138481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.138754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.139025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.159135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a59a-e7bb-4220-9aea-f13ba69928ab None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.193545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.194469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.195132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.195132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.205616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:18.210730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:18.211683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:18.212598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 322/638] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:18.213289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.227388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.228846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.284656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.326130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.338837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169166d-b0f0-4619-93da-93e778f24496 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.350559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 317/639] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:18.351540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.384469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.385088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.385368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.385640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.386312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:18.386616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.388134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.398116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 323/640] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:18.399397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.465943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d3df8-be4a-46ea-848f-ebd9a578e959 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.504537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.505297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.505581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.505856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.516996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.518485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.524893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac6fb-d342-4070-976b-903af2d91b37 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:18.535335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:18.541164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:18.542241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:18.542241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:18.542241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:18.542241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 318/641] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:18.542241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.557772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.571653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.571891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.572267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.572550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.572822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.573711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:18.574334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.576439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.589711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 324/642] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:18.590680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.650051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c799be-5a59-4511-9c7b-6cb8dd1fab8b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.694731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.695590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.695904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.696178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.709342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.711768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.716903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c4383-74e3-4912-885a-7ac20f04bef8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:18.731465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:18.732884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:18.733787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:18.733787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:18.733787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:18.737769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 319/643] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:18.738721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.753379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.753985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.754266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.754538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.768092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.769611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:18.784589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:18.785715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:18.786997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:18.786997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:18.786997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:18.788386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 325/644] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:18.789295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.835157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.840760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.857732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701075-621c-4a12-a7d3-3bb6967c189f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.899742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.900376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.900769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.901056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.901708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:18.902011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.903630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.911100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617169-6ea5-4310-8d85-613c25d2d7e2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.927093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 320/645] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:18.927093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.968804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.969645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.969901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.970239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.983942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.985523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:19.001625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:19.003752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:19.004619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:19.004619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:19.004619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:19.004619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 326/646] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:19.004619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.055702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a021db-8338-4684-aee6-2b1c4d4e2770 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.105013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.108811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.109538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.109879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.110219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.111114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:19.111524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.113147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.123986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9f9e-b196-446b-adc1-ea4a626bc1c9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.125969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 321/647] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:19.131031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.134840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.169991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.170679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.170968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.171271 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.171924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:19.172228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.173674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.191302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 327/648] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:19.191302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.256301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105eee92-6c9c-42d4-b964-5549b98cd0ac None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.293047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.294214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.294756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.295034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.303668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.304187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96143f6-d7b8-496e-ad29-02d136ee6027 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.305261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:19.317263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:19.318236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 322/649] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:19.319207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.354505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.355215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.355477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.355718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.356838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:19.357145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.358553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.370905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 328/650] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:19.371638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.383864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.407782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.454922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422d82-d9b3-4b59-9e66-c11ac103450f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.494236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44604-13ac-4fee-8778-081946fe893f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.497665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.498319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.498594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.498873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.506283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.507819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:19.519549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:19.520734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 323/651] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:19.521616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.539816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.540490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.540754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.541017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.549640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.551131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:19.573372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:19.574707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 329/652] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:19.575973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.638421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03918565-3752-488a-8745-bf5ce03b17ee None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.648270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.663398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.675472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.676205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.676558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.676888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.677695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:19.678064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.679544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a1b5d-6eb8-4d11-80bc-a8c12dd22371 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.693304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c30c3-ad1d-40ef-8b5c-8b0272f0df19 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.697466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 324/653] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:19.698697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682e15-d6ee-4c8a-a5cd-f37501b511a4 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.699339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682e15-d6ee-4c8a-a5cd-f37501b511a4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.699615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682e15-d6ee-4c8a-a5cd-f37501b511a4 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.702891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 325/654] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:19.702891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682e15-d6ee-4c8a-a5cd-f37501b511a4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.735690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.736323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.736597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.736843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.744920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.746528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:19.759173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:19.760404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 330/655] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:19.761840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.822603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682e15-d6ee-4c8a-a5cd-f37501b511a4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.860902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.861832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.861832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.862131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.862732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:19.863031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.864493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.870922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ccee-6498-4808-8551-35d7cf2eacaf None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:19.876948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 326/656] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:19.877666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:19.901477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.913980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:19.914622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.914895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.915183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.915912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:19.916210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:19.917640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56627-b95b-4a58-8814-df5d2705d57d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:19.922410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:19.936531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 331/657] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:19.937939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:19.938249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:19.938580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:19.958087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:19.959421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:19.994756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede65a0-c5bf-4bac-951d-e2d9e3cf0ea6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.034105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.034720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.034998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.035297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.040983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 332/658] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:20.041827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.154634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.157317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.175205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981475b-4f81-4f76-970a-0d00a2d73b80 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.196545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.218416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.222751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.223544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.223907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.224270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.225100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:20.225504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.227144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.246647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 333/659] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:20.247598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.301533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 327/660] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:20.302749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.373096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96484382-c7e5-490f-a997-22ba137f878a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.409562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.410090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.410369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.410639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.411419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=c0a103b9b799406fab32d0eaa4965592) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:20.411731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.413174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.416482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14212570-eea3-4837-9eb6-38d83e69e898 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.419796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 334/661] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/role_assignments?user.id=c0a103b9b799406fab32d0eaa4965592&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:20.420382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.457644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.458263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.458488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.458760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.473930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.486884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.557050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.558544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.571596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf715b-03b5-44a1-9781-2ef544142505 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.616991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.617506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.617867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.618047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.698608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 328/662] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:20.699746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.717187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.719037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.752742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.781963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.822899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021e308-8773-48d3-ad16-1219f15ec42e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.860288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 335/663] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:20.861134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.871535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.872396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.872680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.872945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.884476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.886003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:20.901638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:20.902660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:20.904021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:20.904021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:20.904021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:20.904021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 329/664] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:20.904021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.985670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb49a-95b5-443e-8098-6bc4e2c9fb9c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.027926 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.028815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.029225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.029640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.031836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.038104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.042675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:21.045828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7afe4-eb07-4cfe-b567-c634fdd2a79c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:21.047982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:21.049104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 336/665] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:21.054969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.089378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.090084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.090433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.090886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.103568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.105176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:21.120839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:21.123016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:21.124059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:21.124059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:21.124059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:21.124059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 330/666] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:21.124059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.203541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad0a3-1e9f-4a1d-993a-e6c556f27bb5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.250398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.251936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.251936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.251936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.266516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.267655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33e16-720b-4e35-8570-a793a27f3501 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.268372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:21.287662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:21.288671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:21.294671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:21.294671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:21.294671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:21.294671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 337/667] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:21.294671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.312922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.313667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.314013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.314351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.315113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:21.315870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.316943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.336614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 331/668] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:21.336614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.343938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.354983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.410685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34215e1-2128-429a-8c1e-3e86f82e96eb None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.451808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.452760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.453151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.453304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.453948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:21.454244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.455654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.458910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dc9e9-3696-492e-aabb-8aad87445d4d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.470095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 338/669] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:21.470095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.514258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.514798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.515089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.515373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.516033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:21.516482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.517888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.536159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 332/670] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:21.536159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.601573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5bd2-e7ee-4f78-bd8e-3f9dfb330083 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.616753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.623460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.641665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.642280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.642553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.642822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.643494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:21.643791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.645165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.658975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 339/671] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:21.659954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.666943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035c771-99bd-4fc7-82f4-f21ca647c310 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.703960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.704599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.704879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.705156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.713078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.714531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:21.726707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:21.727771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:21.728641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 333/672] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:21.729143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.780418 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc47b9-a25a-4dd0-ad4e-82f2d03d4b65 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.826691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.827370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.827653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.827927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.841376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.844531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:21.861757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:21.864149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:21.865953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:21.865953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:21.865953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:21.865953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 340/673] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:21.865953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.874424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5dc56-1a45-415f-9df0-8d25a4dd9d44 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.896551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.903379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.915973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.916774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.917306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.917519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.925488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.926901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:21.944344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:21.945277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:21.946146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:21.947991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 334/674] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:21.948919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.992472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951834d-74f4-4787-bade-679b27cd6d88 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.035310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.035883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.036150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.036478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.049654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.051181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:22.065037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:22.066423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:22.067752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 341/675] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:22.068236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.088559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72058a75-e5ab-461c-85ca-fcaa56a70b7b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.146502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.147394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.147855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.148321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.150129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.151032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.154764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.179620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 335/676] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:22.181488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.204892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.229575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1910-c5a4-40a2-ac95-e1fa757e6dc4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.255630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.276117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.276743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.277024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.277299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.277966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.278420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.279859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.293255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 342/677] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:22.294049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.332158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be06e41-0cf9-4f38-b1ad-20418bec5d42 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.370449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.371071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.371349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.371792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.373748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.373748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.374654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.387759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 336/678] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:22.388482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.417662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346cc95-e0f5-4db1-8b60-b8baa221dffe None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.458469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.459203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.459490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.459773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.460541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.460847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.462711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.475231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 343/679] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:22.476055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.479794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.507688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c2fd-7ca1-4e28-b3aa-d3cc6542011e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.516168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.552539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.553058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.553336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.553612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.554356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=28f32f08ac32498ba75eb4faa022f464) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.554665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.556462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.562444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 337/680] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/role_assignments?user.id=28f32f08ac32498ba75eb4faa022f464&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:22.563278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.630323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7654c-72a3-41cf-b657-132b37160ae7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.679160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.680033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.680311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.680580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.690917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.694697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-9182cb75-9a95-412c-8f93-75b933da8ed9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:22.713915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:22.714954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 344/681] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e96a1-5ee8-4e62-8fd5-40a52cabc07e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.716977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e96a1-5ee8-4e62-8fd5-40a52cabc07e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.717698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e96a1-5ee8-4e62-8fd5-40a52cabc07e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.723787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d435b7-0616-41eb-8558-1c7e70b3104b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.723986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 345/682] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:22.724951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e96a1-5ee8-4e62-8fd5-40a52cabc07e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.781722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.782342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.782649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.782892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.784045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=e8980803eace443d849c22a6e0781894) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.784045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.785449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94d8ab-e846-4486-905a-01f45ae746f6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.792953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 338/683] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/role_assignments?user.id=e8980803eace443d849c22a6e0781894&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:22.793764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.794286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.794286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.816839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:22.818192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:22.833058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.852937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.889575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e96a1-5ee8-4e62-8fd5-40a52cabc07e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.923574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 339/684] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:22.924483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.970692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.971464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.971749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.972025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.972884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=fc76f59ac1054c18a5e03cc0a18db502) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:22.973199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.974860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.989333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 346/685] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/role_assignments?user.id=fc76f59ac1054c18a5e03cc0a18db502&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:23.069900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d042c5-7d1a-4ab2-8427-0572be53438f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.114433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.115078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.115366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.115643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.116404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:23.116710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.118209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.141375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 340/686] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:23.146745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.270291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.283835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390b1c6-43bf-4cc6-a824-a378227ac49f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.302342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:23.325838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:23.332755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.333057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.333340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.333734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.410459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fe16-c6d5-450b-93b5-8ca8c194f637 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.441577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.443077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.474196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.474840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.475144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.475417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.499880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.501383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:23.536370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:23.537408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:23.538306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:23.538306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:23.538306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:23.538306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 341/687] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:23.545926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.630816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 347/688] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:23.636799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.686767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:23.703761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:23.738241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9892717-df98-494e-b231-edcf8ab79023 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.784993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.786041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.786041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.786265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.786921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:23.787331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.788654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.808132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 342/689] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:23.815750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.849439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247abb2-6bcf-40f3-b9b2-34e25c2eca80 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.892893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.893955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.894436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.894899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.906418 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.908313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:23.927385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:23.928947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:23.930215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:23.930215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:23.930215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:23.932385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 348/690] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:23.944289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.996576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e463c4-f8fc-49b8-846e-a1e5e9e75c82 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.051794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.052460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.052743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.053017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.053698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.055797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.071535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:24.081508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:24.082628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 343/691] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:47:23 2022] POST /identity/v3/users => generated 254 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:24.110940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6816576-c16e-4a85-8699-7681fdbd3aa2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.156311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.157751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.158207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.158654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.159628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:24.160106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.161907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.182265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 349/692] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:24.192238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.371631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6f599-8cb7-44bf-bca4-692ee03e9979 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.418568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.419620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.420119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.420587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.429750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.431264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:24.445742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:24.446738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:24.447640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 344/693] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:24.454353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.584666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a42a6-839f-4f65-a43a-1335bfb4108e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.630602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.631805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.632274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.632743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.633661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:24.634138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.635807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b574-b861-4e34-bb32-cabddc7f6499 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.646297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:24.650150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 350/694] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:24.662917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.731391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:24.814849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ab0f-01ae-4998-b0f0-660751908d6a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.875779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.876394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.876679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.877007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.877748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=3592ce2e44b3470b8a5299295364031d) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:24.878103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.879692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbeb34-6589-4c22-860b-7444bdb8da52 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.892787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 345/695] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:24 2022] GET /identity/v3/role_assignments?user.id=3592ce2e44b3470b8a5299295364031d&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:25.069236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4d4d-d0b6-4d99-8a9f-2997c4bcf16c None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.069631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4d4d-d0b6-4d99-8a9f-2997c4bcf16c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.069806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4d4d-d0b6-4d99-8a9f-2997c4bcf16c None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.071501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 351/696] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:25.077985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266d77-85a3-4b9b-8c59-db9686ce044d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.078311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266d77-85a3-4b9b-8c59-db9686ce044d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.078528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4266d77-85a3-4b9b-8c59-db9686ce044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.105055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b4266d77-85a3-4b9b-8c59-db9686ce044d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:25.106279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b4266d77-85a3-4b9b-8c59-db9686ce044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:25.218352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 346/697] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:25.539999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4d4d-d0b6-4d99-8a9f-2997c4bcf16c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:25.554807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711856-195b-4994-85f8-39cb595a6796 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.555350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711856-195b-4994-85f8-39cb595a6796 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.555442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711856-195b-4994-85f8-39cb595a6796 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.557246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 347/698] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:25.566371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.567133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.568255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.593249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:25.594809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:25.661690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:25.690678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4d4d-d0b6-4d99-8a9f-2997c4bcf16c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:25.704235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 348/699] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:25.739815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613bc50-f8bb-412c-ba6e-ad08eecc899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:25.740475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613bc50-f8bb-412c-ba6e-ad08eecc899e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.740730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613bc50-f8bb-412c-ba6e-ad08eecc899e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.741002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613bc50-f8bb-412c-ba6e-ad08eecc899e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.757073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613bc50-f8bb-412c-ba6e-ad08eecc899e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7613bc50-f8bb-412c-ba6e-ad08eecc899e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:25.762185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:25.763481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:25.764599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 352/700] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:25.769440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:25.781044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba726-4b5b-496b-88ec-b162c57f7126 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.781499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba726-4b5b-496b-88ec-b162c57f7126 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.781949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba726-4b5b-496b-88ec-b162c57f7126 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.784691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 353/701] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:25.792783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.793128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.793535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.828311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:25.829524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:25.972566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef17a49-c606-4e6d-b4d4-bbf7a32f9038 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:25.974152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.004644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 354/702] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:26.026580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.027554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.028088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.028616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.029497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:26.030032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.031623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.041637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.048508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 349/703] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:26.057004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.140155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.168897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8516fc-f5c3-43ee-b7a1-dbdc0a59167e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.220889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.221845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.222311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.222931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] PATH_INFO: `/v3/services/network` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.224295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.226362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:26.248112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:26.249226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:26.250061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:26.253936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 355/704] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:26.259922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.304473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fd539-b5d3-4b2e-a602-220826791790 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.347024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.356110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.357048 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.357592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.358086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.373334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.375664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:26.393741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:26.394858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:26.395798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:26.395798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:26.395798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:26.395975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0bd0d-281a-489f-b7bc-d75a7b064493 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.398127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 350/705] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:26.399132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.432273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.433131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.433417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.433689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.434806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] RBAC: Adding query filter params (name=network) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:26.435324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.437273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.443590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 356/706] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:26.444969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.506100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.523537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676e39b-8f40-4d8b-9a36-49d611eb4b53 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.572207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.573379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.573852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.574320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.576372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.579142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.583715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0880-fc7f-42a5-bf11-13c3a5c17bcb None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:26.604438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:26.605557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:26.606381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:26.608825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.614643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 351/707] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:26.614643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.635563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.636573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.637020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.637450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.638864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:26.639362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.641422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.658065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 357/708] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:26.658989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.771662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66679402-b8e9-4048-b396-ecc6cf582788 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.798861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5d23a-6e32-49c6-8db7-d91123bb9f77 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.816049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.816379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.816649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.816924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.817575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] RBAC: Adding query filter params (type=network) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:26.817879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.819321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.831017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 352/709] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:26.831017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.859146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.862866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.863994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.864537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.865054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.866501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:26.866930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.868392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90408933-753e-4095-9593-ce1dc8c25906 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.875744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 358/710] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:26.877826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5929c-5593-4130-99e2-df287f76d3ae None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.878309 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5929c-5593-4130-99e2-df287f76d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.878753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5929c-5593-4130-99e2-df287f76d3ae None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.886657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 359/711] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:26.888152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5929c-5593-4130-99e2-df287f76d3ae None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.952260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.977438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e10048-f18c-4c7d-9837-775cf1f9bd0e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.030858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:27.031538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.031805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.033664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.046304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:27.047855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-da68d43b-6bb4-48c5-bb55-892eb68d2b45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:27.060528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:27.062356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 353/712] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.064792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.067367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.083896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:27.084979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:27.092112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5929c-5593-4130-99e2-df287f76d3ae None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.148202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:27.149071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.149573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.149966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.155012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:27.155012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:27.155012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:27.166180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 360/713] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:27.167325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:27.234424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 354/714] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:27.391655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12c271-6627-4b0b-a7de-4c2d537d8992 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.419741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:27.458974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:27.459630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.459912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.460188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.460941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:27.461249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:27.462708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:27.497731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 361/715] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:47:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:27.508942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:27.526494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:27.631636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:27.638695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8e23f-a3c8-4298-ba8c-43895f018075 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.676869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf2b64-af87-4ee8-8abd-4741a4542019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:27.677384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf2b64-af87-4ee8-8abd-4741a4542019 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.677661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf2b64-af87-4ee8-8abd-4741a4542019 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.677941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf2b64-af87-4ee8-8abd-4741a4542019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.753742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf2b64-af87-4ee8-8abd-4741a4542019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:27.755285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf2b64-af87-4ee8-8abd-4741a4542019 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:27.764134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:27.843885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87b9f-9f0a-452a-82b3-6ea17994e09a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.862989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 355/716] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:27.864404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7a56-d4ce-41be-92a3-83de4806d0d4 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.864691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7a56-d4ce-41be-92a3-83de4806d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.865037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7a56-d4ce-41be-92a3-83de4806d0d4 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.871558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 356/717] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:27.871558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c7a56-d4ce-41be-92a3-83de4806d0d4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:27.914681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34957-f9a2-4247-93ba-7f8f9fd9929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:27.916280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34957-f9a2-4247-93ba-7f8f9fd9929c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.916940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34957-f9a2-4247-93ba-7f8f9fd9929c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.917668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34957-f9a2-4247-93ba-7f8f9fd9929c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.938168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34957-f9a2-4247-93ba-7f8f9fd9929c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4ae34957-f9a2-4247-93ba-7f8f9fd9929c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:27.948391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:27.949354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:27.950993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:27.958614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 362/718] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:27.961063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.961562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.962038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.992181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c7a56-d4ce-41be-92a3-83de4806d0d4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.994272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:27.996478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:28.002979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.038119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.038825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.039073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.039181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.039448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.056714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.059155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:28.078302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:28.079346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:28.080222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:28.080222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:28.080222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:28.084583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 357/719] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:28.085449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.137382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 363/720] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:28.139186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.198883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392dfd-f342-4723-98bb-b8e32bf1484f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.240363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.241516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.241926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.242206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.242884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:28.243372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.245403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.255398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 358/721] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:28.260635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.291558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.379561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e9778-0f1c-4ca5-935f-b60e04c783cb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.393163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc3510-d0ce-4173-a105-a74cec8d078a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.422097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.423152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.423782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.424385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.437311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.439848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:28.456958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:28.457913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:28.458785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:28.458785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:28.458785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:28.461471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 359/722] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:28.476094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.482897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.483567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.483845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.484113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.484772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:28.485181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.486785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.499682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 364/723] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:28.505742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.531186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.592289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.627636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdef295-11d0-4051-bcec-eb72b7905d08 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.640350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce716e-7d7f-4094-a0cc-ba9df6670cf6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.664302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.665491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.665917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.666331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.667169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:28.667611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.669214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.676773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.677439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.677720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.677993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.686186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.687728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.688377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 360/724] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:28.689396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:28.704875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:28.705995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:28.707033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 365/725] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:28.708010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.786803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.801439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84b50-002e-4d60-990f-b0de7778b089 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.814649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e186a7-13d9-49dc-bb04-2b16210f7bb9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.833612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.840641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.841863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.842588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.843289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.850827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.851445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.851728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.852000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.858069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:28.860159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.861632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:28.863868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:28.864791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:28.865623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:28.868563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 361/726] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:28.869574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:28.873376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:28.874480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:28.875501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:28.879335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 366/727] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:28.880190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.987502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ff3f-abe6-47cd-a4eb-a7b1c1be93ef None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.987948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6168-fbea-4f38-9515-c8e08a5771de None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.024578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.024787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.025377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.025653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.025921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.026320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.026580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:29.026879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.027268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.027729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.028285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.029317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:29.029858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.029992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.031414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217393c-dfcf-4d7c-b11c-3cc2abbe9a1f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.042161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 367/728] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:29.042161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.048927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 362/729] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:29.053880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af7a2-d0bb-4a18-982d-5565626689a5 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.053880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af7a2-d0bb-4a18-982d-5565626689a5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.053880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af7a2-d0bb-4a18-982d-5565626689a5 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.053880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 363/730] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:29.053880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af7a2-d0bb-4a18-982d-5565626689a5 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.112311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.160632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818bd14-5a87-47b0-8d6b-8fc85aa24e60 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.173581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af7a2-d0bb-4a18-982d-5565626689a5 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.199485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.200398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.200726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.201201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.201707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:29.202004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.203959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.213708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.214349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.214611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.214877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.224654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 368/731] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:29.227236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.228993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.229726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-7cf333cf-f98a-4679-9773-ad239a82795f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:29.243567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:29.244527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:29.245406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:29.245406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:29.245406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:29.245406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 364/732] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:29.246138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.246237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.246481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.269255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:29.270893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:29.305914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.359082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 365/733] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:29.359082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.384513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb348670-943b-4ce0-9875-4b0cbe864dee None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.388946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.427183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.428069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.428355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.428627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.429667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=28f32f08ac32498ba75eb4faa022f464) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:29.429984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.432367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.443219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 369/734] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/role_assignments?user.id=28f32f08ac32498ba75eb4faa022f464&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:29.444182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.492481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b9b6-855d-48fa-8455-61c907cff01c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.565098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.565828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.566105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.566372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.641213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab501-31ea-4493-b7b8-fc872c246150 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.664085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.665551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.675016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.702197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.706885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.707554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.707834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.708105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.708758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:29.709056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.710562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.724535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 370/735] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:29.725461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.783152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 366/736] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:29.784088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.836859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7714a-75a2-46cb-8a6b-4f9e9ebc071a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.876660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.877688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.878269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.878778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.879719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.881405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.888791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012942-de71-408c-9ea0-eb088306b89c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.899939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 371/737] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:47:29 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:29.908540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.935350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.937601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.939210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.939497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.939775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.958143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.960023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-1a00c21d-1635-418c-8034-9158f4343425 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:29.976382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:29.978205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:29.979965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 367/738] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:29.984810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a85f0-a72d-4d18-8edc-6e280d681104 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.985069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a85f0-a72d-4d18-8edc-6e280d681104 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.985406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a85f0-a72d-4d18-8edc-6e280d681104 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.991912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 368/739] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:29.991912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a85f0-a72d-4d18-8edc-6e280d681104 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.012233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:30.110632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a85f0-a72d-4d18-8edc-6e280d681104 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.132418 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376b74-b856-4fa4-86d1-d61df4a8683d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.167935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.169891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.170430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.170901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.173281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:30.173995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.177109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.177276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42162c1-ba14-45e9-95b8-f4acc37ffb04 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.177756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.178039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.178315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.189676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.191240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.203626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 369/740] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:30.205004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.205304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.205585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:30.216089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:30.217238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:30.218237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:30.218237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:30.218237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:30.218237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 372/741] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:30.218459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.234580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:30.236820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:30.307441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:30.318494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:30.327888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 370/742] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:30 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:47:30.328860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.346074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626295cb-f204-4abf-8e11-deb686dabcc9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.395457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.395995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.396278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.396619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.482550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.485612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.572625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28854ef7-c5e1-40ad-be78-d2522d27b7c1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.626939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.626939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.626939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.626939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.627402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:30.627584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.629001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.641189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:30.643103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 371/743] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:30.643103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.661912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 373/744] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:30 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:30.663918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.700420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:30.776490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486fd17-c037-4618-9d7a-31df95139fce None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.784251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbf74-e84d-4a70-8611-d7c0937c2461 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.814482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.815480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.815986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.816468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.817515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.819653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.820165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.820802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.821084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.821359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.829101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.830593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:30.843104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:30.844043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:30.844955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:30.851129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 372/746] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:47:30 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:30.851129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.851422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 374/746] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:30.852907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.969746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:31.071582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:31.082184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bfb0f-01fc-4111-9dc2-a85894d99c42 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.091473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380e075-5f51-4027-b22a-3019589c1a8b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.131906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.133108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.133914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.134839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.135553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:31.135553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:31.137813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:31.148544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.149883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.150448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.150896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.169619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 375/747] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:31.172483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:31.175629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:31.178358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:31.201283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:31.202351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:31.203239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:31.203239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:31.203239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:31.203239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 373/748] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:31.208673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:31.354164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd04812-aafc-4a55-9830-6173c7f1f22d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.402295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968b7b9-0327-4e60-a7c6-1db971235ae0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.422315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.423380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.423865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.424344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.425509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:31.426007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:31.428543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:31.436586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:31.453983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 374/749] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:31.463044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:31.480616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:31.513104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.514230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.514717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.515187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.516090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=9dcbe420fec24160a3983a8c93195016) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:31.516586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:31.527075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:31.553520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 376/750] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:31 2022] GET /identity/v3/role_assignments?user.id=9dcbe420fec24160a3983a8c93195016&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:31.668292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f5640-9c67-42d0-812f-aa81206c68c4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.729538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.730609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.731119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.731607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.744072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:31.746817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:31.767459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:31.768389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:31.769280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:31.770225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 375/751] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:31.779885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:31.942509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b637840-3afa-4755-9a57-307df9ca8656 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.995299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.996741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.997428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.998122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.999459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:32.000035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:32.001681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f52a7-5e5c-4fcc-811c-f83b37aef590 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:32.020555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 377/752] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:32.026489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:32.159436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:32.199742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df319b-7458-4001-b84b-86c0e03b0952 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:32.200102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df319b-7458-4001-b84b-86c0e03b0952 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:32.200813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df319b-7458-4001-b84b-86c0e03b0952 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:32.202511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 378/753] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:32.214598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197e0b6-da25-4eb5-856f-caed12b21c22 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:32.215102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197e0b6-da25-4eb5-856f-caed12b21c22 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:32.215498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197e0b6-da25-4eb5-856f-caed12b21c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:32.218779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d855d1-234a-449d-a0ba-878d4c972714 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:32.250019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-3197e0b6-da25-4eb5-856f-caed12b21c22 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:32.251293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3197e0b6-da25-4eb5-856f-caed12b21c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:32.287253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:32.287868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:32.288146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:32.288415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:32.289155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=3592ce2e44b3470b8a5299295364031d) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:32.289517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:32.291110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558830da-dff0-4f09-9fb5-aa403c53f657 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:32.299653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 376/754] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:32 2022] GET /identity/v3/role_assignments?user.id=3592ce2e44b3470b8a5299295364031d&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:32.311515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:32.397150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 379/755] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:32.642615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158311-1448-46f2-b266-2e41470a82c8 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:32.643456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158311-1448-46f2-b266-2e41470a82c8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:32.644280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158311-1448-46f2-b266-2e41470a82c8 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:32.647480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 377/756] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:32.653170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:32.653505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:32.653765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:32.680393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:32.681571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:32.709887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158311-1448-46f2-b266-2e41470a82c8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:32.800999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 380/757] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:32.830776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158311-1448-46f2-b266-2e41470a82c8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:32.860587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:32.867563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:32.868210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:32.868490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:32.868764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:32.880230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:32.884843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:32.885746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:32.886611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 378/758] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:32.892205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.010551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:33.019921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc4a8a-58a1-4b7a-9664-c1c47540b79a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.057885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:33.059245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.059887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.060402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.061387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:33.062162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:33.064957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3a55-cf86-48df-9636-ba07a692363f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:33.081124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 381/759] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:33.087365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.199165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d420a8-81a3-4bb4-bfa7-9b97238fcfaf None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.216812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd4dd9-2445-4f13-b003-1d6d6dfb4907 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.217156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd4dd9-2445-4f13-b003-1d6d6dfb4907 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.217358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd4dd9-2445-4f13-b003-1d6d6dfb4907 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.218862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 382/760] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:33.224429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.224953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.225419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.246725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:33.250278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.250563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.250842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.251957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:33.253382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:33.264749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:33.266771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:33.286546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:33.293732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:33.298291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:33.298291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:33.298291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:33.298291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 379/761] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:33.298291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.349674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 383/762] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:33.350964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.357389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:33.469260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0887c09-4da5-4ef2-8dc6-b2a42cea0e96 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.539538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:33.559269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e3e83-f82c-4345-9d98-61f772992732 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.564043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:33.564704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.564987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.565262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] PATH_INFO: `/v3/services/network` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.565862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:33.567288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:33.590704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:33.591980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:33.593135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 380/763] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:33.600737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.651881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:33.652869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.653340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.653641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.654636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:33.655069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:33.657092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:33.695495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 384/764] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:33.696423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.744570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d99580-6ffe-4d07-bab6-25588056013a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.753471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:33.785871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:33.786491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.786767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.787035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.787725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:33.788123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:33.789664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:33.796295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 381/765] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:33.797306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.842200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a004-e345-40ce-b941-f5af617e57e0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.903717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:33.905062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:33.906244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:33.906671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:33.920538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:33.923754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:33.944534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b2204-4100-4d46-ab7b-184253212bd6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:33.955826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:33.957610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 385/766] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:33.967826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:33.985077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.033532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.034513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.034902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.035421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.036763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.038615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:34.048974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:34.051589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:34.053260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 382/767] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:34.056307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.097675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.165853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e680eb-d150-4017-9ad2-f962bdd888f9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.194340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65875371-b5e8-436b-97ea-ea2e9e271787 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.219956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.221370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.221816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.222393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.223333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:34.223817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.225945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.234724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 386/768] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:34.237008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.240884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.241583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.241924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.243413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.244574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:34.245039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.247310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.281713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 383/769] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:34.281713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.354367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.393742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb38ef-406d-42fa-b05c-5b19a64b43d7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.423782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.437209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb90b0-eedc-4105-9636-915f82b9803f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.442686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.443338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.443624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.443882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.444524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:34.444825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.446302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f1ebd-9e71-4afb-91e3-e8ebc4a5ba16 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.458866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 387/770] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:34.458866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed1ac-5deb-4c20-af79-ab2ed191d94c None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.458866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed1ac-5deb-4c20-af79-ab2ed191d94c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.458866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed1ac-5deb-4c20-af79-ab2ed191d94c None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.458866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 388/771] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:34.458866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed1ac-5deb-4c20-af79-ab2ed191d94c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.491794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.492953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.493392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.493837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.495015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] RBAC: Adding query filter params (interface=public, service_id=cf638023f0b7421e8bb10380ed6536f0, region_id=RegionOne) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:34.495540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.497804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.512829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 384/772] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/endpoints?service_id=cf638023f0b7421e8bb10380ed6536f0&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:34.515149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.591689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed1ac-5deb-4c20-af79-ab2ed191d94c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.635246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.636235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.636695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.637141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.640750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.652523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.653998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.657133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264eb9d5-899b-4a67-a5c7-1d07d6aea729 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-74cc62f9-e8f3-49b9-9ac5-a3f80a9c0f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:34.670727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:34.673005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 389/773] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.675318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.699167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:34.700957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:34.720021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.720975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.721263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.721536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.722178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:34.722488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.723925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.729820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 385/774] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:34.731100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.764670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.802734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 390/775] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:34.804152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.865255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de8b1-c70a-4220-81b9-e8106fcd870f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.920945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.921784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.922230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.922747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.923520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.925873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.936351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 386/776] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:34.937289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.975768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38409b-b956-4cac-9379-d189e736ee04 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.000020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:35.029657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.041590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.042341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.042816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.044027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:35.044863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.047653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd0fd-d1b5-4930-8edf-ed2323c0d172 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.066678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 391/777] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:35.068108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:35.070377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a3078-6875-48f1-ac55-302dfe05ec1d None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.071213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a3078-6875-48f1-ac55-302dfe05ec1d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.071791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a3078-6875-48f1-ac55-302dfe05ec1d None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.079480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 392/778] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:35.081391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a3078-6875-48f1-ac55-302dfe05ec1d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.089227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c40f8-e14f-48c5-a3e3-b7ccf59b1626 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.146598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.147248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.147543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.147804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.148503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] RBAC: Adding query filter params (interface=public, service_id=137b6380fc2d44db8e8496c6ad5310bb, region_id=RegionOne) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:35.149179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.154126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.162779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 387/779] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/endpoints?service_id=137b6380fc2d44db8e8496c6ad5310bb&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:35.162779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.224758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a3078-6875-48f1-ac55-302dfe05ec1d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.271456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.272556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.272945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.273349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.282620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.284137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4acc9215-0ccb-4673-9ef7-c851e76a48a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:35.303971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:35.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:35.307335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 393/780] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:35.311547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.311881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.312164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.320617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14820bec-1fb4-4b2b-acc8-c2edd1838a4a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.335995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:35.337299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:35.368781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.370253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.370673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.371114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.381735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:35.389401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:35.398764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:35.400142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 388/781] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:35.411237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.421493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:35.454617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 394/782] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:35.454846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.557571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bd48b-96aa-4d04-940b-e63171dc664c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.612730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.613916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.615095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.615680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.617273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.619916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.633735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 389/783] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:35.634920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.658208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e38ce-cd35-4324-9c36-e00c4861aff5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.758602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.759858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.760317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.760726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.761603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:35.762653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.765213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.781360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 395/784] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:35.792222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.815550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:35.847983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:35.858504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b694e-abc5-4fd8-98ae-ec3176293dae None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.920141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.921647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.922391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.923149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.924574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:35.925378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.928475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.939488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd186ac6-8343-4133-8e64-58dcf68156bf None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.944490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 390/785] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:35.946224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.975425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.976116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.976991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.976991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/28f32f08ac32498ba75eb4faa022f464/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.978957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=28f32f08ac32498ba75eb4faa022f464, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.980503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.998504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 396/786] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:35 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/28f32f08ac32498ba75eb4faa022f464/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:35.999591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.158421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.186861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76158e6-717e-4e76-812e-9a3d20fca735 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.198110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf782f-b15b-4613-8d73-c0764fb29df5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.230216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.231143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.231739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.232147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.245967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.247813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.264863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.265319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.265755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.266124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.268823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:36.272867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:36.273999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:36.275030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:36.275030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:36.275030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:36.276792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 397/787] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:36.283583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.288231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:36.292936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:36.294080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:36.300974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 391/788] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:36.302430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.419637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c072-b9ff-4e5c-8d63-9227b44b9805 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.464124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.468252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.469031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.469594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.470992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:36.471758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.475190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.487321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 392/789] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:36.494135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.516085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55343c85-75c4-4931-a7da-8ede7aa820c6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.578746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.583811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.586248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.586778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.588169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.589026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:36.590909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.592876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.611140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.628441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 398/790] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:36.636898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.694868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb2e2-5fbb-4624-8b67-b298dba0964b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.747421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.748545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.748884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.749156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.762982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.765480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:36.787328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:36.788315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:36.789607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:36.789607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:36.789607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:36.789607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 393/791] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:36.795770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.933226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a1c22-c5f1-4004-b2eb-1e5a35a0d0b2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.938408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea3f6-bd82-4b91-8001-20beb5fd3da4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.953461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.994073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.994972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.995387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.995757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.999941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.000986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.001629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.002141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.003441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:37.003966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.005970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.006714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.015203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:37.026593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:37.027706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:37.028633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:37.029167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 399/792] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:47:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:37.037318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 394/793] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:37.040238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.040934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.153650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:37.282203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03050a84-abf7-4932-9cb5-21ace13ffde3 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.310396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42edd4-a099-4088-8559-dc971f1ffb8c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.357487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.358761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.359273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.359739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.368933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.370882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.373468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.374042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.374316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.374570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.375379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:37.376188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.377123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:37.387770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:37.388984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:37.390777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:37.395334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 395/794] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:37.401992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.441127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:37.528411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c094abc-2b64-4732-8c4c-d7e43ee41d2b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.566653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.568259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.568941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.569616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.571138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:37.571675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.573663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.594994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 396/795] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:37.600989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.610788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 400/796] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 571 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:37.616695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.715497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:37.732833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95172d1-20f3-4562-87b4-ef0554294d4b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.775087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.776774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.777503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.778269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.794596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.796640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:37.818956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:37.819971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:37.820832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:37.820832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:37.820832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:37.822683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 397/797] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:37.830743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.866673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cc31b-3a8a-4e67-817e-a08e40d41b29 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.886458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:37.915569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.916471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.916756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.917032 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.935968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.938179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-fa93c9f1-029c-45eb-92d8-53ae16ab10c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:37.957755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:37.958856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:37.959793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:37.959793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:37.959793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:37.963170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 401/798] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:37.964703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9865-267c-41d9-b09f-c388cec92215 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.965424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9865-267c-41d9-b09f-c388cec92215 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.966142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9865-267c-41d9-b09f-c388cec92215 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.969473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 402/799] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:37.971204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9865-267c-41d9-b09f-c388cec92215 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.977612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe69a35-9d48-41c8-9fd2-fa7e5128f800 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.021135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.021768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.022052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.022329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.023009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:38.023361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.024774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc22f-2112-4e84-8adf-750e573f1651 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.033787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.041993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 398/800] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:38.043852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.044146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.044426 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.069273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:38.071905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:38.114139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9865-267c-41d9-b09f-c388cec92215 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.156166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.157241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.157695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.158138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.158961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:38.159475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.161210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.171144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 399/801] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:38.175635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.183426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 403/802] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:38.190838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.259553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.347130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cac06-523a-4214-ba38-037d18f844c9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.366741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e188f-6139-4d49-9efe-dfdd12d31b6f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.379337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.391300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.391926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.392355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.392762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.402039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.403533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.412342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.413853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.414681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.415025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-7c1ab11c-c634-4aec-b56e-1933fc441992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:38.421300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:38.428413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 400/803] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006ce17-f084-49a7-9be0-754ac22874e6 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.431281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006ce17-f084-49a7-9be0-754ac22874e6 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006ce17-f084-49a7-9be0-754ac22874e6 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 401/804] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3725e-3c75-4bb6-9953-bca0a0375028 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3725e-3c75-4bb6-9953-bca0a0375028 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3725e-3c75-4bb6-9953-bca0a0375028 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 402/805] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:38.432464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3725e-3c75-4bb6-9953-bca0a0375028 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.440629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.440629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7c8ccfcf-e7a9-44f7-8684-c4d9e9c5b010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:38.454775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:38.455764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:38.456648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 404/806] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:38.457143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd1b32-8e32-47a7-a102-e890044cda49 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.457577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd1b32-8e32-47a7-a102-e890044cda49 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.458236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd1b32-8e32-47a7-a102-e890044cda49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.479365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-afbd1b32-8e32-47a7-a102-e890044cda49 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:38.481030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-afbd1b32-8e32-47a7-a102-e890044cda49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:38.559444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 405/807] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:38.560710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.561028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.561370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.572922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3725e-3c75-4bb6-9953-bca0a0375028 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.581045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:38.582235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:38.601216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.620170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.620784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.621066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.621342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.622040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:38.622339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.623937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.639173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 403/808] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:38.644275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.673984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 406/809] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:38.684882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.710890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.784898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d478f-fb6c-40c5-ba59-bc8aa7a99334 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.818827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750fb7-4cdc-426f-a0d1-b896b31ffb26 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.838901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.839780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.839924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.840179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.840890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:38.841198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.842725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.854911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 404/810] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:38.855479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.866048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.867106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.867643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.868066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.869282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.871195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:38.883683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:38.884920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:47:38.886020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:38.888563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 407/811] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:38.889646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.911371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.975808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92927-0af0-4222-bcb1-edc04d0c81bc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.985826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.001058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cfb77-e5d7-41d0-8bf3-6597f151c0d7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.011465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.012133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.012410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.012681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/3592ce2e44b3470b8a5299295364031d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.014726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=3592ce2e44b3470b8a5299295364031d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.016193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.030109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 405/812] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:38 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/3592ce2e44b3470b8a5299295364031d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:39.030971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.043990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.044646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.044922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.045249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.045843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.047437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:39.057037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:39.058366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:39.059208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 408/813] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:39.060002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.175044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09500da6-8864-4364-904b-ddc6edd265bd None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.176807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.205459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c4f7-2013-4674-b66c-e03712235b69 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.219873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.220534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.220810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.221076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/9dcbe420fec24160a3983a8c93195016/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.237573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=9dcbe420fec24160a3983a8c93195016, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.239025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.243449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.244476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.244978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.245303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.246019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] RBAC: Adding query filter params (name=network) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:39.246330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.247776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.252813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 406/814] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:39 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/9dcbe420fec24160a3983a8c93195016/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:39.253958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 409/815] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:39.258629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.264177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.288461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.389781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aefc6-4112-4dc0-af69-a1f864fc4995 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.416459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66554e30-83ad-47ba-aee4-727d9e111a7b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.450487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.451977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.452271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.452540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.461154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.462020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.462504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.463002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.463899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:39.464413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.465958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.470082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:39.471765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 410/816] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:39.472866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:39.475098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:39.476034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:39.476884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:39.477507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 407/817] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:39.482380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.485829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.575492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.610324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6bea-ef38-4521-a13f-34920c2500fb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.612736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916f37a-4049-4b21-aed7-78521320ecba None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.656870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.657649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.658029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.658498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.659089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] RBAC: Adding query filter params (type=network) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:39.659478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.660908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.664793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.665613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.666118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.666580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.667406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:39.667889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.669419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.671014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 411/818] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:39.672082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.677400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 408/819] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:39.678446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.752994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.798045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e989eb-92a0-41f7-a23e-7ed486b01aaf None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.811940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d0d4-bd38-475b-98f9-f077cebc9ac1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.849258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.849504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.850076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.850185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.850360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.850454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.850611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.850804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.851329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.851812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:39.852251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.852964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.854227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.866856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 412/820] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:39.867816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.880298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:39.891629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 409/821] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:39 2022] POST /identity/v3/endpoints => generated 337 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:39.892687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.982614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587ad7-3ab0-4217-8cf9-e495c2df1e42 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:40.022714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:40.056158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:40.056806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:40.057094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:40.057339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:40.058023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:40.059473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:40.101112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 413/822] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:40.107041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac691-daea-4833-b329-e3240e28f179 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:40.176313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:40.177316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:40.177814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:40.178285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:40.192729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:40.194734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:40.218902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:40.219981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:40.220847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:40.220847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:40.220847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:40.226988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 410/823] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:40.229609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:40.349976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cdafc-ef0f-4c3a-9051-93f8bd791c6b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:40.394609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:40.395668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:40.396222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:40.396662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:40.397736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:40.398269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:40.400441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:40.423872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 414/824] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:40.429334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:40.483873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:40.543688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125fc0-2689-4829-b12b-0664c57e2f5e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:40.581368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:40.582413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:40.582891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:40.583395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:40.712519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:40.714367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:40.727607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:40.728598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:47:40.729572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:40.732187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 411/825] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:47:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:40.738550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:40.787324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:40.850903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda533c8-f6bc-4ccb-bec8-e1851114330e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:40.887933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:40.888922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:40.889466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:40.890236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:40.891266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:40.891772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:40.893408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82989a76-aba9-4ad6-802c-5ad4da67dd3b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:40.917201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 415/826] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:47:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:40.923840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.040568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bbca5-6ab0-4fd4-af11-6c202e28b4fd None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:41.049285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.078897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:41.079911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.080469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.080933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.088664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced091-5fcc-411a-94a9-fabe05b5c85f None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.088941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced091-5fcc-411a-94a9-fabe05b5c85f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.089220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced091-5fcc-411a-94a9-fabe05b5c85f None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.090894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 416/827] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:41.096480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34eaba-7e5f-4250-a889-5722a3f6b6bc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.096749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34eaba-7e5f-4250-a889-5722a3f6b6bc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.096987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34eaba-7e5f-4250-a889-5722a3f6b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.120941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-db34eaba-7e5f-4250-a889-5722a3f6b6bc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:41.122159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-db34eaba-7e5f-4250-a889-5722a3f6b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:41.168150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:41.169908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:41.219241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 417/828] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:41.269492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f86e-7ff8-42bd-97e5-a02b82049d0e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.270244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f86e-7ff8-42bd-97e5-a02b82049d0e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.270244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f86e-7ff8-42bd-97e5-a02b82049d0e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.271862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 418/829] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:41.277385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.277669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.277942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.297905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:41.298809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 412/830] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:47:41.299693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:41.304911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.316718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.334559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.373445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 419/831] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:41.416207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754b7b-9995-4de1-b7f8-6089e7d7fff2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:41.451559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:41.453209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.453686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.454172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.465111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:41.466922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:41.486046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:41.487093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:41.487983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:41.487983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:41.487983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:41.490289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 413/832] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:41.495868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.510220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.605472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.662393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad97b3-cf31-4f96-ba1e-8c8974417d80 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:41.675969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb3ccb-df8a-4946-94a7-ed7eadda212b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:41.709723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:41.712294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.712640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.712951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.713681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:41.714109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:41.715793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:41.727618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:41.728324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.728760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.729036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.733623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 420/833] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:41.736051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.742329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:41.750764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:41.751829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:47:41.752660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:41.753866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 414/834] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:41.754740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.773669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.885724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599c23c-cfd5-4244-8296-f12de057053f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:41.935932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f848-f1f0-428d-9c8f-f99f4aa73357 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:41.938282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:41.939117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.939347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.939622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:41.950578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:41.956871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:41.959452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:47:41.960307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:41.962543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.962944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 421/835] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:47:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:41.963837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:41.989443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:41.990518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:41.991013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:41.991538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.002294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.004642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:42.022710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:42.024041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:42.025022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 415/836] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:42.026413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.084828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.111323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc4f29-aaa7-4291-a86a-e35a6cce8e9d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.169834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.170389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.170748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.175948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.176678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:42.177119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.178875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.192881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 422/837] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:47:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:42.193980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.198993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c89ab-ce6b-46a0-b984-636f2819fa3d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.249832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.250469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.250764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.251006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.251741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:42.252045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.253510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.263850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 416/838] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:42.264895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.318423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.338915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4f86-94ce-40df-aa13-2c87c181b731 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.378501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.379146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.379430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.379703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.380406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:42.380711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.382162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.394895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 423/839] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:42.395756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.398665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121975-1bd3-4d38-93d3-5a67d6432754 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.401297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.438281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.438834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.439136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.439408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.450807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.454306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-e641d5a7-4c9e-40a0-9b90-5be107896054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:42.467315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:42.468300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:42.469209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:42.469209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:42.469209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:42.469209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 417/840] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:42.469843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9929c-8106-4c12-a545-b9873adc373e None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.470110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9929c-8106-4c12-a545-b9873adc373e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.470330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9929c-8106-4c12-a545-b9873adc373e None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.471605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 418/841] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:42.472278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9929c-8106-4c12-a545-b9873adc373e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.510892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90cc7-e56d-4041-867c-9412b42f7002 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.552446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.553080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.553360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.553629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.564517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.565976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.572940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:42.581428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:42.582395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:42.583323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:42.583323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:42.583323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:42.583323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 424/842] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:42.583704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.594559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9929c-8106-4c12-a545-b9873adc373e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.634633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.635278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.635560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.635833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.636562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=28f32f08ac32498ba75eb4faa022f464) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:42.636894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.638357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddac60-4100-4d5c-9b32-4038fdd9bb26 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.644412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 419/843] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/role_assignments?user.id=28f32f08ac32498ba75eb4faa022f464&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:42.645770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.645936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.646047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.646313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.667145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:42.668379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:42.716980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92361d-3aba-4665-88dd-6b00c8136180 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.761106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.761782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.771265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 420/844] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:42.771532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.771532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.771735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.771831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:42.771831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.771831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.784736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 425/845] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:42.794064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.892208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.913350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3dc3-7efc-4d28-b921-82a42f6134ff None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.934305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150517f3-94af-4ebb-9f8e-e117232d1632 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:42.950490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:42.965068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.966237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.966939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.967567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.968857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:42.969602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.971220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:42.973182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:42.973896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:42.974231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:42.974932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:42.986640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 421/846] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:42.991889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:42.996882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:42.998368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:43.019853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:43.020962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:43.021980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 426/847] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:43.026483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.114934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f4be-6f7d-4379-9c88-52827337351c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.136419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81a701-5fb7-4afc-95f7-7c3c188eb83e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.150595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.151683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.152204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.152673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.161317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.163075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:43.174451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:43.175668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:43.176804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:43.180377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 422/848] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:47:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:43.181105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.182554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.183246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.183521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.183786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.184573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:43.184868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.186529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.191435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:43.211026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 427/849] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:43.211026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.240392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:43.302123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fd2d5-e43a-43da-9aa8-81f6451fb301 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.318252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb9e2-0a25-4b2c-b197-d978ee3a1f70 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.337236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.337877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.338149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.338414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.338986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.340383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:43.351451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:43.352714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:43.354214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 423/850] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:43.358308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.361082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.361784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.362064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.362329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.363105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:43.363419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.364853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.383043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 428/851] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:43.383841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.448694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:43.485343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ea73e-eb0e-4b68-8bce-7ccc84e4c6ce None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.491898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:43.509089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ca8e-6ba9-4cf5-b144-051234f354e5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.537237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.538002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.538274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.538855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.552867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.553476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.553757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.554016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.554648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:43.554950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.556318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.562450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 429/852] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:43.563291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.642571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.645364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.728610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e26f-ba62-4428-a9b0-6ccba90bab7b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.753347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:43.781848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.782658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.783198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.783697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.797682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 424/853] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:47:43.802933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.813327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:43.866025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.867627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.918180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8beb27-2727-4509-aab8-bc096c50f067 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:43.956037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:43.956634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:43.956907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:43.957170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:43.957800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:43.958102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:43.959505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:43.971105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 425/854] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:43.971105 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:43.989316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 430/855] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:47:43.995130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.018584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.074737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.108654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8585e-3562-45b8-87ed-c2b9f3fe9bbd None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.152895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c0962-ede4-4d4c-84f5-ed7ff552b995 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.172657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.173583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.173850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.174123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.187338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.188812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.202719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.203877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.204359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.204888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:44.209302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:44.210231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:44.211579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:44.211579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:44.211579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:44.211579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 426/856] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:44.216165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.222511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.224289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:44.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:44.248043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:44.248990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:44.248990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:44.248990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:44.252161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 431/857] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:44.258495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.334367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.355597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c0b68-999f-4e73-9846-9684234c01bf None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.396213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dc74e-e9ab-4422-b961-2ec4804b92a0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.400751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.401525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.401893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.402175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.402846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:44.403175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.404586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.406853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.428074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 427/858] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:44.430667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.458513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.459247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.459758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.460163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.461008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:44.461449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.462464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.480983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 432/859] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:44.490732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.561119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07164e23-581d-48ea-be7a-2e723dcf8ad8 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.604124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.604717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.604998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.605271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.613097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.614563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:44.626133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:44.627085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:44.628081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:44.631892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4e5f-f347-4c78-8db0-5b74f9c511f9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.632402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 428/860] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:44.633254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.642876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.680952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.682268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.682744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.683508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.693171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.695880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-0faa0da4-492e-4605-81ac-adf2bbba2a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:44.711660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:44.712611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 433/861] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a06a-5b97-4796-a447-1d4cae0cb0f9 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.714719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a06a-5b97-4796-a447-1d4cae0cb0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.715383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a06a-5b97-4796-a447-1d4cae0cb0f9 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.716708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 434/862] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:44.722359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a06a-5b97-4796-a447-1d4cae0cb0f9 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.758143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3fb0-f97e-45f6-90ce-b0cee5fcde37 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.761681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.800161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.801281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.801780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.802272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.803645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:44.804145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.806420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576445-624f-41c0-8943-8bd462a63f6a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.827392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 429/863] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:44.827392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.827392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.827392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.853059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:44.854335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:44.869944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a06a-5b97-4796-a447-1d4cae0cb0f9 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:44.916299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:44.916925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:44.917209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:44.917481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:44.918192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:44.918517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:44.919992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:44.932119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:44.938389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 435/864] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:44.939110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:44.948180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 430/865] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:44.949073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:45.068474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:45.091002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d418-141f-4b38-9499-3f3200fbe07a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:45.100784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e0930-cc25-4abf-998b-a71b68eaf98a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:45.144956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:45.145701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:45.145975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:45.146419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:45.147616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=9dcbe420fec24160a3983a8c93195016) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:45.147996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:45.149554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:45.150611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:45.151469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:45.152175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:45.152663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:45.153617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=3592ce2e44b3470b8a5299295364031d) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:45.154874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:45.157172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:45.171437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 431/867] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/role_assignments?user.id=9dcbe420fec24160a3983a8c93195016&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:45.171851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 436/867] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:44 2022] GET /identity/v3/role_assignments?user.id=3592ce2e44b3470b8a5299295364031d&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:45.245547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:45.333331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:45.385967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7bf6-a779-4660-94f2-65bb1c3a20ca None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:45.436730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:45.437371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:45.437687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:45.438000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:45.438598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:45.440019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:45.452585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:45.453805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:45.455330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 432/868] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 09:47:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:45.459933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:45.567086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a519-86f1-46f1-92b9-daf81a41cc61 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:45.602965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:45.603614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:45.603883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:45.604152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:45.604784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:45.605078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:45.606448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90af0-02c6-4a3e-9254-42af7a8038e7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:45.612197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 437/869] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:45.617787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:45.731544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867dd70-9e25-4424-b8f1-578cbcc50913 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:45.758254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:45.771811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:45.772429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:45.772710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:45.772983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:45.773631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:45.773933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:45.775358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc2d0-4fac-4e25-99ce-8406f5f8feaf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:45.780833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 433/870] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:46.098277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca848af-56cf-4644-be05-ba732bf039bc None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:46.098795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca848af-56cf-4644-be05-ba732bf039bc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:46.099257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca848af-56cf-4644-be05-ba732bf039bc None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:46.100992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 438/871] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:46.106444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7a46-9c6e-40e1-9314-962777515305 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:46.106848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7a46-9c6e-40e1-9314-962777515305 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:46.107264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7a46-9c6e-40e1-9314-962777515305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:46.126274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0e6a7a46-9c6e-40e1-9314-962777515305 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:46.127515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0e6a7a46-9c6e-40e1-9314-962777515305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:46.204953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 434/872] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:46.512043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca848af-56cf-4644-be05-ba732bf039bc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:46.536590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:46.628775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca848af-56cf-4644-be05-ba732bf039bc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:46.668113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275b4ca-207a-4ba0-826e-62a2fae297cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:46.668738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b4ca-207a-4ba0-826e-62a2fae297cb None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:46.669019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b4ca-207a-4ba0-826e-62a2fae297cb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:46.669290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b4ca-207a-4ba0-826e-62a2fae297cb None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:46.669943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275b4ca-207a-4ba0-826e-62a2fae297cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:46.672003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275b4ca-207a-4ba0-826e-62a2fae297cb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:46.696069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 439/873] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:47:46 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:47.335850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0616f5-e662-44b0-bdbb-87e8cc9b0157 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:47.336795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0616f5-e662-44b0-bdbb-87e8cc9b0157 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:47.337242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0616f5-e662-44b0-bdbb-87e8cc9b0157 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:47.339122 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 435/874] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:47.345541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:47.345840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:47.346101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:47.365357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:47.366554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:47.410102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1a895-a71e-491f-9a99-579204a7b848 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:47.410924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1a895-a71e-491f-9a99-579204a7b848 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:47.411560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1a895-a71e-491f-9a99-579204a7b848 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:47.414799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 436/875] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:47.419906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:47.420536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:47.421405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:47.444893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:47.446129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:47.449314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:47.459167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 440/876] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:47.537680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 437/877] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:47.793204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:47.868459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:47.913147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf7bc2-90fc-4c5e-a0b6-f7e21d5e99c2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:47.951713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:47.961057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:47.961701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:47.962100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:47.962392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:47.963156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:47.964775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-34d146fd-e41e-49a3-a350-469d7b373ea4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:47.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:47.976755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:47.979969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 441/878] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:47.980935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b02f5-8fe8-494c-9127-583a757cb7d6 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:47.980935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b02f5-8fe8-494c-9127-583a757cb7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:47.980935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b02f5-8fe8-494c-9127-583a757cb7d6 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:47.980935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 442/879] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:47.982835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b02f5-8fe8-494c-9127-583a757cb7d6 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.039558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5e5b3-a0c2-4ee5-8079-b2bc6dd3c2de None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.054705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:48.077530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd711f-e3ca-4a3e-8fa8-d090f9be623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.078431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd711f-e3ca-4a3e-8fa8-d090f9be623d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.078867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd711f-e3ca-4a3e-8fa8-d090f9be623d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.079188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd711f-e3ca-4a3e-8fa8-d090f9be623d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.089550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd711f-e3ca-4a3e-8fa8-d090f9be623d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-47cd711f-e3ca-4a3e-8fa8-d090f9be623d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:48.095292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:48.097075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:48.098698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 438/880] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 09:47:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:48.102017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.102017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.102017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.105389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b02f5-8fe8-494c-9127-583a757cb7d6 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.122132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:48.123556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:48.145853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.146573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.146843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.147159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.147790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:48.148093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:48.153160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:48.165861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 443/881] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:47:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:48.165861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.215445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 439/882] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:48.223246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.274976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:48.315916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b9e0c-0b81-402f-a345-d479e47942dd None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.349027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:48.363399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.364059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.364343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.364618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.365296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:48.365599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:48.365997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a382-ab29-40c1-85cc-2844f16c3f3e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.367134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:48.378975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 444/883] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:47:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:48.388559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.413361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.415195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.415839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.416472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.418263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:48.418887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:48.421979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:48.429550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 440/884] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:47:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:48.521265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.527580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710a1a7-56cc-486d-9e85-370e250eb36d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.576079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.576780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.577066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.577752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.600706 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:48.602188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:48.623677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:48.625044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:48.626088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:48.626088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:48.626088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:48.628483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 445/885] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:48.635354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.675310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de304dc-5271-4f8a-9eb7-0a941ee91edf None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.677174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:48.705763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:48.722637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17967dc0-5d18-4789-8ff7-6359efa2419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.723484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17967dc0-5d18-4789-8ff7-6359efa2419f None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.723875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17967dc0-5d18-4789-8ff7-6359efa2419f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.724360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17967dc0-5d18-4789-8ff7-6359efa2419f None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.725407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17967dc0-5d18-4789-8ff7-6359efa2419f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:48.727351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17967dc0-5d18-4789-8ff7-6359efa2419f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:48.751202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 441/886] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:47:48 2022] POST /identity/v3/services => generated 269 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:48.788857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575001c-724c-4608-8376-3a758cf5f416 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:48.838153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:48.838806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.839042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.839372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.840052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:48.840452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:48.841901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:48.846817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0594e9-598c-4729-bfcd-9c50d695c8ec None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.847187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0594e9-598c-4729-bfcd-9c50d695c8ec None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.847430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0594e9-598c-4729-bfcd-9c50d695c8ec None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.849075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 442/887] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:48.855219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:48.855542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:48.855780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:48.857194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 446/888] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:48.863183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:48.888230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:48.890946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:48.994124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 443/889] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:48.998529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.010007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7ea59-a5a0-4aeb-b173-4a616643f1f0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.052893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.053810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.054213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.054506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.063769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.065236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:49.078064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:49.079505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:49.080855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 447/890] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:47:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:49.085810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.190845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.207142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc07a9-5586-4b2a-91e4-2f111fe6689e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.254552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.255500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.255962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.256378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.257498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:49.257903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.259383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.283314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 444/891] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:49.288686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.312004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.430789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03e25-fa5f-4eed-9e1d-88a728fde568 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.438178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801ac4c-eec5-44fe-90ec-4ceb1ee3e0c1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.471720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.472264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.472542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.472814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.478342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.479258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.479738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.480204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.481018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.482771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:49.492908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:49.493961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:49.494767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:49.502931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.503288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 445/892] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:49.505375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.524038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.550796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.552197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.618578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809181-6cec-460b-ac64-2284a65599ea None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.656618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.657615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.658093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.658561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.659548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:49.660049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.661682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.665533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 448/893] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:47:49.667161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 446/894] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:49.672319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.679493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.764432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.794480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.824736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fd453-b398-4b39-8949-29afa34ad2b2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.826798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64534-7900-4e60-b14d-0a2d077247e8 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:49.864116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.865132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.865613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.865744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:49.866286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:49.866561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:49.866835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.867180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:49.868012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:49.868615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.870362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.876229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 447/895] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:49.883602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:49.885567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:49.887772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:49.908822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:49.909818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:49.910727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:49.910727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:49.910727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:49.910727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 449/896] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:49.923551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:50.019191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99761b0-f8e2-4b93-85d0-8474b197ad0e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:50.045092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25caf39-5b76-4e4a-8b2e-c88cdf7a1e36 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:50.057261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:50.069579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:50.070310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.070683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.071147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.071958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] RBAC: Adding query filter params (interface=public, service_id=a65b83e975c24543962313c40c730da8, region_id=RegionOne) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:50.072357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:50.074084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:50.086416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 448/897] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/endpoints?service_id=a65b83e975c24543962313c40c730da8&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:50.087597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:50.090252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:50.092408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.092990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.093716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.094732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:50.095241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:50.096804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:50.099072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:50.115937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 450/898] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:50.122681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:50.223656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28981834-e457-453e-84b3-08837d4c0f5d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:50.259126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc31d-a92f-41cf-9d4d-ef1392d3cd0f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:50.270027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:50.271271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.271865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.272414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.273226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:50.275366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:50.287098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 449/899] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:47:50 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:50.307175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:50.308143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.308544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.309007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.318493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:50.320044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:50.335008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:50.337000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:50.337887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 451/900] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:50.343592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:50.454625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:50.497541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c808b-ac0d-43b3-b166-e7e7a0f9b902 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:50.543935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:50.544471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.544752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.545027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.545743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:50.546050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:50.548224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78c81a-d9ad-48ee-a20e-e94fb42c5856 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:50.566033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 450/901] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:50.575816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:50.628709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:50.662989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816359-aaf5-4f83-bad4-ad10a20d651f None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.663345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816359-aaf5-4f83-bad4-ad10a20d651f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.663560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816359-aaf5-4f83-bad4-ad10a20d651f None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.666360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 451/902] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:50.673608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f4f1-b999-4a18-99aa-ac403f5cce83 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.674221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f4f1-b999-4a18-99aa-ac403f5cce83 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.674706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f4f1-b999-4a18-99aa-ac403f5cce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.694552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ccb5f4f1-b999-4a18-99aa-ac403f5cce83 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:50.696277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ccb5f4f1-b999-4a18-99aa-ac403f5cce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:50.713198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab3a33-b2cf-4411-9ef6-befaeeed5502 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:50.754289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821752be-234e-468c-bccc-e318e6145780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:50.754946 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821752be-234e-468c-bccc-e318e6145780 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:50.755254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821752be-234e-468c-bccc-e318e6145780 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:50.755572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821752be-234e-468c-bccc-e318e6145780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:50.756407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821752be-234e-468c-bccc-e318e6145780 None admin] RBAC: Adding query filter params (role.id=c11623614d8f4c64bff683d6faceefc5, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=9dcbe420fec24160a3983a8c93195016) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:50.756715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821752be-234e-468c-bccc-e318e6145780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:50.758172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821752be-234e-468c-bccc-e318e6145780 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:50.764559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 452/903] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:47:50 2022] GET /identity/v3/role_assignments?user.id=9dcbe420fec24160a3983a8c93195016&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=c11623614d8f4c64bff683d6faceefc5 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:50.798597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 452/904] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:51.103179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29058d-daf1-4c9b-8fff-a6e8d5013a8b None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.103741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29058d-daf1-4c9b-8fff-a6e8d5013a8b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.104236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29058d-daf1-4c9b-8fff-a6e8d5013a8b None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.106491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 453/905] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:51.115329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.115715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.115997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.128959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29058d-daf1-4c9b-8fff-a6e8d5013a8b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:51.137423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:51.138664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:51.229157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:51.243108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 453/906] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:51.279094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29058d-daf1-4c9b-8fff-a6e8d5013a8b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:51.287290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:51.315230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:51.316146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.316628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.317067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.317889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:51.319476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:51.341329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 454/907] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:47:51 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:51.555219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:51.669895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeb1ef-df79-4b2c-81f3-465498b98621 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:51.727023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:51.727692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.727966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.728232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.728901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:51.731223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:51.744837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:51.745816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:51.746691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 454/908] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 09:47:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:51.754474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:51.886102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc57f1-e501-4d45-ae15-45a6971458e7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:51.927765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:51.928771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.929262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.929724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.930551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:51.931115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:51.932687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:51.939678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 455/909] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:51.945848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.008642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:52.072325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3e49c-fb24-4b5a-811e-1eeb9e4f7d16 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.124349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.125042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.125913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.125913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.126377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:52.126695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.128092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.133924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 455/910] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:52.142329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.172199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:52.286605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b9e02-c40e-4dd2-84e0-3df0f8c4e5b0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.323363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.323980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.324259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.324531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.325299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] RBAC: Adding query filter params (interface=public, service_id=82576fbc85944316926fedeb8c461c4a, region_id=RegionOne) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:52.325609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.326983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbf75b-5188-490a-b244-45deffaa6d19 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.336013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 456/911] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:47:52 2022] GET /identity/v3/endpoints?service_id=82576fbc85944316926fedeb8c461c4a&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:52.342872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.452087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc068d3-1435-457f-bca5-5d49286cc797 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.467747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:52.489687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bde1f-1d41-48ca-9ff2-16686506d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.490301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bde1f-1d41-48ca-9ff2-16686506d526 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.490580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bde1f-1d41-48ca-9ff2-16686506d526 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.490849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bde1f-1d41-48ca-9ff2-16686506d526 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.491496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bde1f-1d41-48ca-9ff2-16686506d526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.492881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bde1f-1d41-48ca-9ff2-16686506d526 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.499743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 456/912] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:47:52 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:52.618261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029c26-1b2d-4099-b49d-82f143467ec4 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.618575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029c26-1b2d-4099-b49d-82f143467ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.618904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029c26-1b2d-4099-b49d-82f143467ec4 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.620688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 457/913] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:52.628193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5a16-b49e-4d06-b711-78c940564bd5 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.628193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5a16-b49e-4d06-b711-78c940564bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.628193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5a16-b49e-4d06-b711-78c940564bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.648961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4b0d5a16-b49e-4d06-b711-78c940564bd5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:52.650453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4b0d5a16-b49e-4d06-b711-78c940564bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:52.735021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 457/914] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:53.026943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781ce7-4024-48bc-8bac-7e829b9ed005 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.027210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781ce7-4024-48bc-8bac-7e829b9ed005 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.027591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b781ce7-4024-48bc-8bac-7e829b9ed005 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.029091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 458/915] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:53.034961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.035283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.035564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.057956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:53.059251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:53.103407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781ce7-4024-48bc-8bac-7e829b9ed005 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.147452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 458/916] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:53.215465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.232529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b781ce7-4024-48bc-8bac-7e829b9ed005 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.272852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.273524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.273804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.274078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.274673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.276079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:53.285501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:53.286488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:53.287339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 459/917] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:53.292629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.337103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.403280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72352d27-e530-453c-97e2-d6d466e45154 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.442073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.442713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.443293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.443570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.444243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:53.444547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.445986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.452286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.452540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 459/918] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:53.459900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.587711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b351a-cdca-49cd-8f39-99e96e5dab42 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.610570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcdf72-16a8-46c6-8161-5a7a6c1e5973 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.613341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.632986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0b0c5-7f70-4953-8000-1fef932a8704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.634041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0b0c5-7f70-4953-8000-1fef932a8704 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.634682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0b0c5-7f70-4953-8000-1fef932a8704 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.635113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0b0c5-7f70-4953-8000-1fef932a8704 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.653845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0b0c5-7f70-4953-8000-1fef932a8704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:53.657113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.657912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.658065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.658352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.658891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:53.659233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-7fc0b0c5-7f70-4953-8000-1fef932a8704 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:53.659491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:53.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:47:53.662605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:53.665496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.666086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 460/919] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:53.667909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc100c6-cc5f-4c4c-8e8d-8624587120cf None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.668197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc100c6-cc5f-4c4c-8e8d-8624587120cf None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.668453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc100c6-cc5f-4c4c-8e8d-8624587120cf None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.675186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 461/920] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:53.675186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc100c6-cc5f-4c4c-8e8d-8624587120cf None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.675438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 460/921] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:53.675438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.688315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.798813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e49ae-cfd6-4030-a9fb-166c2c2ddebc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.831030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc100c6-cc5f-4c4c-8e8d-8624587120cf None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.840791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13600871-b512-44e7-a978-5cf11ba38a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.841471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13600871-b512-44e7-a978-5cf11ba38a51 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.841752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13600871-b512-44e7-a978-5cf11ba38a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.842024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13600871-b512-44e7-a978-5cf11ba38a51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.842707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13600871-b512-44e7-a978-5cf11ba38a51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.845030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13600871-b512-44e7-a978-5cf11ba38a51 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.875083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 461/922] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:53.875083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.875083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.875083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.888579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.889375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.889771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.890130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.891252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:53.891688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.893356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.894735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:53.896046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:53.904550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 462/923] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:53.914193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.920059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.991229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 462/924] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:53.997351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.040300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30139345-c1b0-41f5-bb97-d26061f8e869 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.078397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.079504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.079975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.080467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.092367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.094228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:54.114419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:54.115486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:54.116354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:54.116354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:54.116354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:54.117013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 463/925] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:54.124399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.259041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48e50-02d0-419c-a00d-f09e9000789d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.303964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.305469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.305958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.306431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.307318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:54.307825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.309549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.330458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 463/926] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:54.339915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.340659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.367149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.461578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4240d-d32a-43d7-a0d3-1a2bf90d1af0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.484676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.510235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3815509-80ea-45fe-9178-6b968373484d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.515518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.517061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.517572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.520746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.533947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.535994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:54.550924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:54.552080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:54.553023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:54.553593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 464/927] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:54.558986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.558986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.558986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.558986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.559391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.560267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.561568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:54.571578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:54.573467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:54.575082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 464/928] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:54.579613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.662024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.685984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d96a1d-13d5-47b1-8de0-35ac577599d7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.696982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb67c-b157-4cd5-9a64-9802d5f49bd9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.725017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.725634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.725923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.726195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.726845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:54.727179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.728566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490befb-25d3-4e14-9065-24ac627d86da None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.733582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 465/929] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:54.734866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4676-9770-44c4-bb7e-c2c614b4c302 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.735185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4676-9770-44c4-bb7e-c2c614b4c302 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.735520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4676-9770-44c4-bb7e-c2c614b4c302 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.736862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 466/930] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:54.739332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4676-9770-44c4-bb7e-c2c614b4c302 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.741683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.742484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.742894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.743318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.744198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:54.744501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.745937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ecbdf-3dc6-4f97-b1d5-2303a5595cf5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.768424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 465/931] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:54.769952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.769952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.772070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.800432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:54.802173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.832440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.895070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 466/932] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:54.895070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.896671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4676-9770-44c4-bb7e-c2c614b4c302 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.947924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.948454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.948738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.949005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.949714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:54.950015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.951446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.959787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 467/933] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:54.965386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.979618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.043762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c933-af36-4eab-b8c6-b1c2fe906ebd None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.088149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.089183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.089779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.090242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.110714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.112577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.126081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552a80-759a-4fbe-8682-2be8918955f1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:55.133861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:55.135322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:55.136658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:55.136658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:55.136658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:55.146970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 467/934] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:55.157165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.167184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.167881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.168162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.168433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.169173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] RBAC: Adding query filter params (interface=public, service_id=98f2cc17aa14448b8baa632203a4d5e4, region_id=RegionOne) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:55.169480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.170932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.179157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 468/935] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/endpoints?service_id=98f2cc17aa14448b8baa632203a4d5e4&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:55.184349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.192513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.278826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.300391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92000-1dd2-463e-93c4-6fab48fd5cec None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.317032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a2ce1-5abe-4c4f-b27a-f19126aaf1dc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.342123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.342887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.343159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.343436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.344299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:55.344624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.346022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.354933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.355592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.355872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.356330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.356952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.358352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.359851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 468/936] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:55.361011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.369271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 469/937] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:55.370277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.483791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.523512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ff25d-3ee5-4cb5-bd81-fa41be9c0980 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.543381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b5424-25b1-4274-8c19-707b1c6e7dc9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.586161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.586916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.587299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.587607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.588258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.590040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.592867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.603125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.603802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.604257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.604552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:55.604719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:55.606428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:55.608278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 469/938] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:55.614949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.624591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.628165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:55.651263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:55.652856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:55.654454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:55.662905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 470/939] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:55.671208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.765455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287592e-d92d-495e-951e-156fff215a3a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.804199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c8cd-2e3e-45ac-9073-49d657f224db None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.818632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.820015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.820516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.821597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.822785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:55.823351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.825681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.833844 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 470/940] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:55.839696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.847456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.853010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.853675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.853955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.854236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.854992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:55.855341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.857060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.880042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 471/941] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:55.885121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.962618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.989467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f767c-5754-4baa-9cc4-caa5151a659c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.033387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.034321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.034472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.034693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.035505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:56.035950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.037519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.044885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 471/942] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:56.045840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159f45f-329e-4e6c-8bd7-d442904951ef None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.050510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.096529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba2028-d470-40df-9dc5-b7ab8eb8a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.097235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2028-d470-40df-9dc5-b7ab8eb8a802 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.097509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2028-d470-40df-9dc5-b7ab8eb8a802 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.097786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2028-d470-40df-9dc5-b7ab8eb8a802 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/9dcbe420fec24160a3983a8c93195016/roles/c11623614d8f4c64bff683d6faceefc5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.100134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba2028-d470-40df-9dc5-b7ab8eb8a802 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=9dcbe420fec24160a3983a8c93195016, role_id=c11623614d8f4c64bff683d6faceefc5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.102120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba2028-d470-40df-9dc5-b7ab8eb8a802 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.123343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 472/943] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:47:55 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/9dcbe420fec24160a3983a8c93195016/roles/c11623614d8f4c64bff683d6faceefc5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:56.141118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b3394-482d-44e7-b57f-862f1a8e132c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.141444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b3394-482d-44e7-b57f-862f1a8e132c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.141804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b3394-482d-44e7-b57f-862f1a8e132c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.143313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 473/944] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:56.149616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.149964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.150173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.173401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:56.187733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:56.189831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:56.245128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff0d8-f2c1-43e8-92ad-d5412ff8f786 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.305038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.305985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.306265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.306536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.307325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.308752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.309661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 474/945] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:56.338909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 472/946] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:56.594923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.642590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:56.710830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5e82-404e-4ec0-a0fe-41d846a2cbee None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.754853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.755684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.756228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.756509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.757152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.758616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.761278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING keystone.server.flask.common [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 09:47:56.781146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.sql.core [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:47:56.781146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:47:56.781146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [parameters: {'id': 'a70f436b4c5b4de1888a96fe3e487be1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:47:56.781146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81536) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a70f436b4c5b4de1888a96fe3e487be1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a70f436b4c5b4de1888a96fe3e487be1. Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:47:56.789296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result.read() Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 09:47:56.790096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application yield resource Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise self.value Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application session.commit() Aug 24 09:47:56.791037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:47:56.791967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:47:56.792842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application result.read() Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:47:56.793628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [parameters: {'id': 'a70f436b4c5b4de1888a96fe3e487be1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:56.794477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:56.796574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a70f436b4c5b4de1888a96fe3e487be1. Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:56.799233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 475/947] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Aug 24 09:47:56 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:56.800423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.908668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663a06-31c1-4fc1-a044-ed815b38fe53 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.933972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:56.947260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.947978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.948296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.948610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.956305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.957893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4a5f00d3-a1f5-48ad-af94-82e1a18a7f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:47:56.970111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:56.971115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:56.972204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 473/948] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:56.979919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:57.087959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:57.098923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979f4f-8b97-42c7-8b6e-a1b8f9027ab4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:57.143306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:57.143939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:57.144213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:57.144479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:57.145164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:57.145466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:57.147270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320c21-3bb1-4482-b586-78b97be28346 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:57.169689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 476/949] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:57.708513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97618e-6de9-4bd6-992f-0b8137d3c92f None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:57.708932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97618e-6de9-4bd6-992f-0b8137d3c92f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:57.709047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97618e-6de9-4bd6-992f-0b8137d3c92f None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:57.710705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 474/950] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:57.716372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26c7f9-4b68-42bd-a563-4399295a289b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:57.716855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26c7f9-4b68-42bd-a563-4399295a289b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:57.716932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26c7f9-4b68-42bd-a563-4399295a289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:57.737824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7d26c7f9-4b68-42bd-a563-4399295a289b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:57.739390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7d26c7f9-4b68-42bd-a563-4399295a289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:57.817388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 477/951] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:58.160173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97618e-6de9-4bd6-992f-0b8137d3c92f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:58.289252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97618e-6de9-4bd6-992f-0b8137d3c92f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:58.306012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11249618-1175-4758-a0d1-c66492da9189 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.306448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11249618-1175-4758-a0d1-c66492da9189 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.306823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11249618-1175-4758-a0d1-c66492da9189 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.309789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 478/952] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:47:58.314589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22851-c7bb-46a8-91e2-73f29d0a7193 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.314995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22851-c7bb-46a8-91e2-73f29d0a7193 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.315389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d22851-c7bb-46a8-91e2-73f29d0a7193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.333920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:58.334622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.334991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.335371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.336056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:58.338249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:58.349748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-70d22851-c7bb-46a8-91e2-73f29d0a7193 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:58.351302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-70d22851-c7bb-46a8-91e2-73f29d0a7193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:58.352667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:58.353964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:47:58.355588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:58.363552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 475/953] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:47:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:58.368924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:58.444551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 479/954] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:58.460247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:58.485869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cf79-2b3f-469e-98a3-a214f7452623 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.486171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cf79-2b3f-469e-98a3-a214f7452623 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.486443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cf79-2b3f-469e-98a3-a214f7452623 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.492216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 480/955] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:58.493592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.493864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.494145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.513498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:58.514793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:58.526867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f9eb7-0e66-4197-9b1a-733d0905c40a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:58.527495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:58.585477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:58.586218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.586822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.587215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.588566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:58.589222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:58.591548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:58.600934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 476/956] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:47:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:58.606383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:58.615579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 481/957] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:47:58.755553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9465630-1cc5-4e4b-8ca0-dfdc06a62af4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:58.756095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:58.783888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:58.799874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:58.801279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.801642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.801999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.803040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:58.803596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:58.806789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:58.815424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 477/958] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:47:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:58.820982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:58.909434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5569d-2249-48c6-a0ca-026e0089c271 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:58.956245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:58.957505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:58.958580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:58.959013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:58.964777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095338f5-3554-471b-949a-122928e6afa5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:58.972857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:47:58.978459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:58.979466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:58.980307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 482/959] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 09:47:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:47:58.981109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:58.989142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:59.015097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.015688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.016033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.016441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.017252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.018714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.055494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 478/960] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:59.056459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:59.102075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:59.110399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19be4-30e9-4dd4-8e75-f4cedfa3f523 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.168283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.168901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.169304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.169590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.170408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.171834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:59.181446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:59.182549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:47:59.184023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 483/961] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:47:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:59.199185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:59.207127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41310954-3031-44ca-932f-948bc101fff0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.249133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.249760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.250083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.250359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.251512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:59.251968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.253579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.264129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 479/962] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:47:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:59.271872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:59.273956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:59.342028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c0d9f-86fc-4bdb-b0e6-221e0ce84bcb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.388946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.389309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.389835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.390218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.391381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:59.391931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.394151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.402358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 484/963] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:47:59.410159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:59.420920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:59.432542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88375-bcd2-4ab5-9532-c961a1b47c5b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.478376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.479561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.480044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.480575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.492781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.494583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:47:59.514330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:59.515557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:47:59.516627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:47:59.516627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:47:59.516627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:59.524380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e326c-906d-45e1-a357-9c4bb86bd574 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.524743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 480/964] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:47:59.526074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:59.556909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:59.566895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.567929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.568305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.568757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.569638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:59.570056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.571633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734eea-4c66-4afc-b70a-445929c44fd2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.577530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 485/965] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:47:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:59.590850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8bf23-e5f2-4e79-b805-732fac394d56 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.591285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8bf23-e5f2-4e79-b805-732fac394d56 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.591598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8bf23-e5f2-4e79-b805-732fac394d56 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.598133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 486/966] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:47:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:59.600124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.600425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.600704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.629210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:59.631881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:59.672943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279830-6def-433e-8445-a1d4cbbc0304 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.724902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.725586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.725883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.726160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.727227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:59.727542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.729228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.747182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 481/967] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:59.754504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:59.755811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 487/968] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:47:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:47:59.770439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:59.918073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571ce0-294a-4fc8-8dbe-91661a54476e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:59.964664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:59.965986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:59.966643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:59.967333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:59.980376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:59.982119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:47:59.995111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:47:59.996495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:47:59.997649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:47:59.999969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 482/969] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:47:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:00.007394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.077215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.148789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a5eeb-bd23-45c7-9a5e-64da48ccf61d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.193362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:00.199358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:00.225602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.226718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.227110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.227400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.228933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:00.229359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.232465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.255841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ecc0-d219-46f5-881a-148ee400af51 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.261717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 488/970] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:00.268720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.310107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.311003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.311464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.311937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.312772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.314810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.317979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING keystone.server.flask.common [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 09:48:00.334100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.sql.core [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:48:00.334100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:48:00.334100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [parameters: {'user_id': 'cef1b9fd4e4747a49386a45d9db98b39', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:48:00.334100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81537) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application result.read() Aug 24 09:48:00.355070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:48:00.356305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application yield resource Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise self.value Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application session.commit() Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:48:00.357700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:48:00.358726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:48:00.359696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application result.read() Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:48:00.360828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cef1b9fd4e4747a49386a45d9db98b39', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:00.361677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 09:48:00.362494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:00.367358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 483/971] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Aug 24 09:48:00 2022] POST /identity/v3/users => generated 160 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:00.368327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.439103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210fa6-1724-46e3-9cad-9cc64e48b98b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.482629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be768654-8257-465f-9722-40313727f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.483858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be768654-8257-465f-9722-40313727f5ab None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.484141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be768654-8257-465f-9722-40313727f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.484424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be768654-8257-465f-9722-40313727f5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.529988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57c96f-23c0-4c62-ada1-bd26151893f6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.548265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:00.560069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:00.570415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be768654-8257-465f-9722-40313727f5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.572882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be768654-8257-465f-9722-40313727f5ab None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.573305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.574189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.574683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.575181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.586447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.588673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:48:00.601544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:00.602530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:48:00.603605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:00.606155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 484/972] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:00.612940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.718631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 489/973] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:48:00.720017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be768654-8257-465f-9722-40313727f5ab None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.749013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae23bb-cf6f-4292-a26e-7f70edd53afc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.793603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.794612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.795116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.795702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.796715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:00.797268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.799525 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.824505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:00.850194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 485/974] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:00.867693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be768654-8257-465f-9722-40313727f5ab None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.919831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.921256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.921768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.922240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.937903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.940906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:00.961059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:00.962150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:00.963070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:00.963070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:00.963070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:00.965519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 490/975] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:00.972857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.028541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:01.100636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968ae8-2ba6-44b4-ae13-ed4a44e124f4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.148643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.149278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.149563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.152805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.152805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:01.152805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.153241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.170286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 486/976] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:01.176234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.325502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6c9a2-46c2-4a6a-b8cd-584a1e05239a None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.368258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:01.378951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.379805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.380094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.380451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.390954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.392969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-94486c4b-1061-46d4-948c-6902165278fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:48:01.408697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:01.410073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:01.417787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 491/977] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:01.419680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.433170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2b6c-ee79-478e-a3d9-5ab18f0fce16 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.433545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2b6c-ee79-478e-a3d9-5ab18f0fce16 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.433875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2b6c-ee79-478e-a3d9-5ab18f0fce16 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.435171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 492/978] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:01.443658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.444003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.444397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.476437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:01.477557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:01.564758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 493/979] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:01.584275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707cc0-4434-4443-af06-1c345c7c1e7f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.593167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:01.633752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.634373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.634643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.634912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.635642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:01.635943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.637450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986644a-3f0e-4535-856f-cb71225caa60 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.655104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 487/980] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:01.658815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.737030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6baaf-8da3-4a4f-918c-7989183a5ec4 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.737293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6baaf-8da3-4a4f-918c-7989183a5ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.737593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6baaf-8da3-4a4f-918c-7989183a5ec4 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.739236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 488/981] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:48:01.744670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.744964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.745223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.766595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:01.768689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:01.816474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0246-6cc4-4b57-bb9c-1bfc51e05c31 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.847929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:01.857438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 489/982] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:01.858435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.862089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.863094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.863203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.863415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.864164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] RBAC: Adding query filter params (role.id=c11623614d8f4c64bff683d6faceefc5, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=9dcbe420fec24160a3983a8c93195016) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:01.864477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.865922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.877082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 494/983] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:01 2022] GET /identity/v3/role_assignments?user.id=9dcbe420fec24160a3983a8c93195016&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=c11623614d8f4c64bff683d6faceefc5 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:01.995600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:02.005363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d50c-b542-47ea-a118-9c0cfb896f37 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.051790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.052486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.052839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.053148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.054024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.056236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:02.070088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:02.076861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:02.079682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 490/984] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:48:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:02.084570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.139606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.230287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb338f6-a9e9-48d8-a031-a8cbfbf4b7b7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.273815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.274446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.274878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.275326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.275972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:02.276443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.278278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.284888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 495/985] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:02.289415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959cf3-d336-4c48-9ada-9a1141104f2a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.290925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.340975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.341598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.341886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.342176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.342845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.344280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.356701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:02.367096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 491/986] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:48:02 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:02.447601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b5de5-31be-4a8c-b478-8af4b1342002 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.508712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.509341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.509621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.509914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.510559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:02.510861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.512310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.523281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 496/987] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:02.525857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.567354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:02.703138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e268-af6a-4c93-aba1-2ca8ddd4ab60 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.761624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.762471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.762747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.763012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.763764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] RBAC: Adding query filter params (interface=admin, service_id=98f2cc17aa14448b8baa632203a4d5e4, region_id=RegionOne) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:02.764065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.765438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a2a0-6a14-4616-b2c6-36a4f0ef407d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.772063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 492/988] 10.222.0.65 () {56 vars in 1249 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/endpoints?service_id=98f2cc17aa14448b8baa632203a4d5e4&interface=admin®ion_id=RegionOne => generated 193 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:02.778053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.951994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6f427-f97b-438a-9eb4-f9e69f9ca314 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.968117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:03.004036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd13d-f849-4bb7-81ac-5cee9a1ce14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:03.004628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd13d-f849-4bb7-81ac-5cee9a1ce14a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:03.004901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd13d-f849-4bb7-81ac-5cee9a1ce14a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:03.005176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd13d-f849-4bb7-81ac-5cee9a1ce14a None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:03.005761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd13d-f849-4bb7-81ac-5cee9a1ce14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:03.007176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd13d-f849-4bb7-81ac-5cee9a1ce14a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:03.017305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 497/989] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/services => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:03.930770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14120-2453-4510-9d2a-2b47a2f53d28 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:03.931385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14120-2453-4510-9d2a-2b47a2f53d28 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:03.931385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14120-2453-4510-9d2a-2b47a2f53d28 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:03.932853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 493/990] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:03.938057 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e7d4e-8d57-4f8f-a194-c4aa8b668c35 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:03.938747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e7d4e-8d57-4f8f-a194-c4aa8b668c35 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:03.938747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e7d4e-8d57-4f8f-a194-c4aa8b668c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:03.968237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-217e7d4e-8d57-4f8f-a194-c4aa8b668c35 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:03.970332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-217e7d4e-8d57-4f8f-a194-c4aa8b668c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:04.060832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 498/991] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:04.330213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a14120-2453-4510-9d2a-2b47a2f53d28 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:04.466243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:04.492028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a14120-2453-4510-9d2a-2b47a2f53d28 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:04.542770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:04.543738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:04.544127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:04.544553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] PATH_INFO: `/v3/services/image` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:04.545523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:04.547622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:04.559103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d26ea-35ef-4716-8849-7b550bc2128a None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:04.559470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d26ea-35ef-4716-8849-7b550bc2128a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:04.559708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d26ea-35ef-4716-8849-7b550bc2128a None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:04.559888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:04.563260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:04.564435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:04.565435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 499/992] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:48:04.565584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 494/993] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 09:48:04 2022] GET /identity/v3/services/image => generated 86 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:04.568198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:04.568424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:04.568526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:04.568840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:04.588444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:04.589632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:04.675128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 500/994] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:04.722223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afac983-6b25-4d79-baa2-0f1025fb2c97 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:04.762201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:04.762490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:04.762841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:04.762994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:04.763664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] RBAC: Adding query filter params (name=image) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:04.763979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:04.765346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:04.771308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 495/995] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:04.777832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:04.825531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:04.915959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f5136-ec9e-41ed-b289-adf45a89be18 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:04.956814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:04.958244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:04.958742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:04.959250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:04.960093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] RBAC: Adding query filter params (type=image) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:04.960587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:04.962158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0e9f1-cd11-4226-82ca-ac126ea09096 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:04.968298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 501/996] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:04.972383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:04.991350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:05.058719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe3a24-b017-4311-a9eb-20d4806d2573 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.059009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe3a24-b017-4311-a9eb-20d4806d2573 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.059353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe3a24-b017-4311-a9eb-20d4806d2573 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.060696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 502/997] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:05.066866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.067162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.067428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.086914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:05.088295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:05.124997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09cf44-c8ca-45b4-89ff-a87849a8b95f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.180442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:05.181082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.181360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.181625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.182216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:05.183690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:05.184121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 503/998] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:05.193644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:05.195563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:05.196585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 496/999] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:48:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:05.200657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.237673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:05.346076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010a0d-80be-470b-998b-35c0087d83f4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.384211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:05.384818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.385095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.385363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.386001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:05.386331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:05.387791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:05.394404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 504/1000] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:05.402357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.475400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.521700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:05.555988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66c088-7323-4246-b71c-6c9d28778ca7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.603729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:05.608686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:05.609460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.609737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.610003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.611102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:05.611102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:05.612873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:05.615086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a640-fddf-4c86-b0e8-3492e52c5a7c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.623111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 497/1001] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:05.625262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.653994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:05.654683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.654984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.655283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.655870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:05.657254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:05.667279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:05.668335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:05.669277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 505/1002] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:05.675242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.767134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3820ac-a2e0-4752-a4e6-102decf33177 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.809610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:05.809899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066f2c2-827c-4931-a139-e59136cc7dd7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.810702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.811209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.811667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.813219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] RBAC: Adding query filter params (interface=public, service_id=a5755976c6114706a4939358c246a6fc, region_id=RegionOne) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:05.813417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:05.815907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:05.825425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 498/1003] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/endpoints?service_id=a5755976c6114706a4939358c246a6fc&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:05.834388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.840807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:05.851749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:05.853152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:05.853715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:05.854202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:05.855072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:05.855572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:05.857506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:05.864757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 506/1004] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:05.870818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:05.901442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:05.958142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450285-1ed6-4254-8810-5ad31cff4285 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:05.997976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafc0bd-fc61-4a47-8afc-0e10a541f218 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:06.000370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:06.001004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.001329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.001602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.002215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:06.003642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:06.012133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 499/1005] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:48:06.044289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:06.045253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.045786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.046249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.047195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:06.047685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:06.049645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc593b-9949-4d55-818f-111413ce208e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:06.056036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 507/1006] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Aug 24 09:48:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:06.067776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:06.163001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:06.213347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1568e-e3b4-459c-9262-47ae64398ddb None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:06.257494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e0cc-04ef-4606-9146-013371018bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:06.258115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e0cc-04ef-4606-9146-013371018bd2 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.258393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e0cc-04ef-4606-9146-013371018bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.258666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e0cc-04ef-4606-9146-013371018bd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.259377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e0cc-04ef-4606-9146-013371018bd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:06.260755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e0cc-04ef-4606-9146-013371018bd2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:06.280140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 500/1007] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:48:06.989927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df95887-77a5-4bff-a321-d2de6a233ccd None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.990211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df95887-77a5-4bff-a321-d2de6a233ccd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.990615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df95887-77a5-4bff-a321-d2de6a233ccd None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.992116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 508/1008] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:06.997752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4dcc5-3828-44fd-937a-af8670540081 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.998121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4dcc5-3828-44fd-937a-af8670540081 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.998288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4dcc5-3828-44fd-937a-af8670540081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.017813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f6f4dcc5-3828-44fd-937a-af8670540081 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:07.020412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f6f4dcc5-3828-44fd-937a-af8670540081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:07.129107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 501/1009] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:07.406186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df95887-77a5-4bff-a321-d2de6a233ccd None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.518180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:07.542107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df95887-77a5-4bff-a321-d2de6a233ccd None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.586547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca4608-acf2-49c2-ae94-cbfeaa4ba01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.587196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4608-acf2-49c2-ae94-cbfeaa4ba01b None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.587479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4608-acf2-49c2-ae94-cbfeaa4ba01b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.587755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4608-acf2-49c2-ae94-cbfeaa4ba01b None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.588427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4608-acf2-49c2-ae94-cbfeaa4ba01b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.589815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4608-acf2-49c2-ae94-cbfeaa4ba01b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.610532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 509/1010] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:48:07 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:08.003304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ecfcc-8548-449e-bb01-1cc11ad9f425 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.003664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ecfcc-8548-449e-bb01-1cc11ad9f425 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.003863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ecfcc-8548-449e-bb01-1cc11ad9f425 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.005266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 502/1011] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:08.011012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099b44-2648-4ba1-9015-5d6930bf2aaa None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.011305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099b44-2648-4ba1-9015-5d6930bf2aaa None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.011613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e099b44-2648-4ba1-9015-5d6930bf2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.030607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8e099b44-2648-4ba1-9015-5d6930bf2aaa None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:08.031830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8e099b44-2648-4ba1-9015-5d6930bf2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:08.110175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 510/1012] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:08.349451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36fcd2-e193-481f-ac7a-c7ddd07fcd24 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.349987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36fcd2-e193-481f-ac7a-c7ddd07fcd24 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.349987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36fcd2-e193-481f-ac7a-c7ddd07fcd24 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.351447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 503/1013] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:08.356881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.357159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.357450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.376506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36fcd2-e193-481f-ac7a-c7ddd07fcd24 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:08.377167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:08.378363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:08.441184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:08.452970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:08.467284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 511/1014] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:08.494487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36fcd2-e193-481f-ac7a-c7ddd07fcd24 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:08.534601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:08.535293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.535547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.535846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.537131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:08.538546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:08.548276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:08.549395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:48:08.550233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:08.552646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 504/1015] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:48:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:08.558368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:08.679923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f98be-760b-4ee3-b29e-92620df8b2f9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:08.721614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:08.722231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.722504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.722781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.723432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:08.723735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:08.725220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:08.732658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 512/1016] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:48:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:08.739874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:08.758467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:08.831845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:08.878646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edbb5f-8633-4c30-a08c-2a6aeae73184 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:08.896144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efc420-9511-4989-bbee-620f77202c97 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:08.901645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:08.929465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:08.930538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.930931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.931318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.933612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:08.934143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:08.936897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:08.951373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 505/1017] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Aug 24 09:48:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:08.958423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:08.960430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:08.961791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:08.962177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:08.962496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:08.964558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:08.965363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:08.971144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 513/1018] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:08.973943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:09.139040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259588-3f36-45f4-99fb-fd414f209ed6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:09.139921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81116676-cf40-44ca-be1b-2cd3a16240ef None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:09.194176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:09.198610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef63da-0830-403e-b648-904c636ef3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:09.199742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef63da-0830-403e-b648-904c636ef3a6 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:09.200426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef63da-0830-403e-b648-904c636ef3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:09.201007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef63da-0830-403e-b648-904c636ef3a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:09.202155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cab4ea-d222-411b-9279-6266599ab5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:09.202781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef63da-0830-403e-b648-904c636ef3a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:09.202907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cab4ea-d222-411b-9279-6266599ab5ff None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:09.203798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cab4ea-d222-411b-9279-6266599ab5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:09.204169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cab4ea-d222-411b-9279-6266599ab5ff None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:09.205527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cab4ea-d222-411b-9279-6266599ab5ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:09.205905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef63da-0830-403e-b648-904c636ef3a6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:09.212078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cab4ea-d222-411b-9279-6266599ab5ff None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:09.253798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 506/1019] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:09.254054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 514/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:48:08 2022] POST /identity/v3/projects => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:48:09.633103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e377-760b-415d-a17b-4566d006e752 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:09.633661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e377-760b-415d-a17b-4566d006e752 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:09.633661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e377-760b-415d-a17b-4566d006e752 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:09.634982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 507/1021] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:09.640750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:09.641265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:09.641265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:09.662663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:09.663826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:09.762000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 515/1022] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:10.029226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807e377-760b-415d-a17b-4566d006e752 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:10.076323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:10.141412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807e377-760b-415d-a17b-4566d006e752 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:10.181792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:10.182426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:10.182704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:10.182978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] PATH_INFO: `/v3/services/image` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:10.183591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:10.184962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:10.193938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:10.194928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:10.200072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 508/1023] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 09:48:10 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:10.207350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:10.337460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756cc-2276-40db-ba13-474a531e7486 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:10.349563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:10.380214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:10.380938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:10.381218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:10.381487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:10.382134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] RBAC: Adding query filter params (name=image) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:10.382436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:10.383864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:10.391984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 516/1024] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:10.397619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:10.515238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dc469-69e6-4343-ab10-6e80d0b1b43d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:10.517315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:10.562485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:10.562485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:10.562873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:10.563238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:10.563760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:10.564074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:10.565826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:10.576029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 509/1025] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:10.577379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:10.694180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5f72-027c-409f-9f40-68cea5db3125 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:10.739006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:10.739675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:10.739950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:10.740218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:10.740938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] RBAC: Adding query filter params (interface=public, service_id=761001b931c64830825e6f4e8a90ecc4, region_id=RegionOne) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:10.741254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:10.742675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb6142-e2e1-488b-aace-e72c3a9ec04c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:10.748246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 517/1026] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:48:10 2022] GET /identity/v3/endpoints?service_id=761001b931c64830825e6f4e8a90ecc4&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:10.754369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:10.867303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ee24e-d03e-420f-9e3a-379e59bbc9f6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:10.902900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79ec1d-56df-4e5e-9844-c37e652792fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:10.903538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ec1d-56df-4e5e-9844-c37e652792fb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:10.903813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ec1d-56df-4e5e-9844-c37e652792fb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:10.904079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79ec1d-56df-4e5e-9844-c37e652792fb None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:10.904861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ec1d-56df-4e5e-9844-c37e652792fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:10.906242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79ec1d-56df-4e5e-9844-c37e652792fb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:10.919137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 510/1027] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:48:10 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:11.380727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60abd5-28f9-4208-8e18-3ac4c17a7532 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:11.381367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60abd5-28f9-4208-8e18-3ac4c17a7532 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:11.381876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60abd5-28f9-4208-8e18-3ac4c17a7532 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:11.383846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 518/1028] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:11.389158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:11.389407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:11.389710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:11.405607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69811b-6917-4f77-b416-1ed8de50287f None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:11.405907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69811b-6917-4f77-b416-1ed8de50287f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:11.406153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69811b-6917-4f77-b416-1ed8de50287f None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:11.408132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 519/1029] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:48:11.409875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:11.415218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:11.417137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:11.417548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:11.417998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:11.444970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:11.445235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:11.447205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:11.487822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:11.506855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 511/1030] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:11.536998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 520/1031] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:11.787586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:11.813894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:11.916792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ab02-c17a-44b7-9989-49a14a441e2e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:11.938417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ed5ea-1f67-4d7f-912e-d9a28f9e09bf None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:11.964417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:11.965062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:11.965342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:11.965613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:11.966729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:11.968447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:11.970274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 512/1032] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:11.976083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:11.979987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:11.980633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:11.980906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:11.981171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:11.994027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:11.998789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:12.000292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:12.001387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 521/1033] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 09:48:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:12.006884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:12.011575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:12.043110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:12.097301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38582b4-98c6-4af5-a89b-7dfb84c12d88 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:12.127806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f711ab-0c46-4ce7-805b-0debfe7c8c34 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:12.136121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:12.137059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.137332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.137602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.138263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:12.139897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:12.179469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 513/1034] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:48:11 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:12.187431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:12.188448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.188981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.189434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.190716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:12.191347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:12.193632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:12.210294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 522/1035] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:48:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:12.217043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:12.334488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:12.353370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fc03-d121-469d-99f6-fc8a041d7109 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:12.389752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:12.390391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.390670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.390944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.403081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:12.404577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:12.420912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:12.422042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:12.423252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:12.423252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:12.423252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:12.423252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 514/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:12.436571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:12.542482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:12.562322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcba1e-8f02-45d2-8022-5a60f1245f72 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:12.613221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:12.613764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.614038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.614304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.614974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:12.615302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:12.616685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:12.640798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 523/1037] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:12.646756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:12.760125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96989bcd-acb5-4394-8517-1bfe4269cff5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:12.794628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:12.795293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.795576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.795819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.798900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:12.806560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:12.808274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4c5e18ff-f8ab-4d3e-a69b-32388552d7d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:48:12.820187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:12.821199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:48:12.822274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:12.826512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 515/1038] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:48:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:12.827995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:12.871072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee27a9-9475-4b5a-b6dd-4e6586c1452e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.871261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee27a9-9475-4b5a-b6dd-4e6586c1452e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.871511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee27a9-9475-4b5a-b6dd-4e6586c1452e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.873079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 516/1039] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:48:12.878357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.878641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.878954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.898846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:12.900089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:12.945358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcb3a8-dc49-4bb2-8ade-1d853ca547d1 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:12.978803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 517/1040] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:12.993976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:12.994652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:12.995343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:12.995343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:12.996042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:12.996227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:12.997642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.017914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 524/1041] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:48:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:13.023489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.131556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57f3d-f167-412e-8cbb-8bb62e62b1c0 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.161495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.182214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.182831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.183128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.183401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.255962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.267422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.272975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.274504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.374239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba82f46-f30c-4d19-b838-4824dac0bcc6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.394522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 518/1042] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:13.395805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.428257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.429766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.430231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.430679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] PATH_INFO: `/v3/services/image` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.431085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.432120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.434127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:13.444990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:13.446059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:48:13.446932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:13.451318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 525/1043] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:13.460754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.531687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb01ee-7b44-4d44-a487-ec5b4b0f9c99 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.556902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.572551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.573692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.574215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.574676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.587390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.589413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.590918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef54f-a0eb-41c7-9cba-81918772d5fa None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:13.606623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:13.611382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:13.612764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:13.612764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:13.612764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:13.612764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 519/1044] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:13.614159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.641481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.642106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.642382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.642660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.643399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] RBAC: Adding query filter params (name=image) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:13.643705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.645155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.651107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 526/1045] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:13.656328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.724143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.756163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c296e-b605-4575-991f-ac1bfca5739a None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.793554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5da137-847c-4c7c-8885-05e7e6100c5e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.809367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.811131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.812289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.812714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.813775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:13.815456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.817589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.839665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.840349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.840746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.841023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.841662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] RBAC: Adding query filter params (type=image) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:13.841965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.843371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.844213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 520/1046] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:13.845424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.846309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.855100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 527/1047] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:13.861026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.982972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37456139-09b6-4209-a67b-1c2f9f7d53ca None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.985896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f475bd-ad6f-4a06-9b73-c13ac2da1f9f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:14.021242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.021958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.022243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.022517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.022816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.023212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:14.023489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.023763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.024029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.024609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:14.031353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:14.032911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:14.034931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-8d322e12-6c36-42b4-89a8-6d9278c90a56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:48:14.046415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:14.047636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:14.048544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:14.049002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 528/1048] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:48:14.054250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 521/1049] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:14.058616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:14.142964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:14.223857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa62dfc-2ff8-44cb-be98-d8e36698286b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:14.263985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.264592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.264868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.265213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.265920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:14.266218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:14.267717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4feeb-e432-475d-b52a-3276cf6c9f6e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:14.280438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d2e0c-9abc-41ef-b47c-9daa472916bf None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.280780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d2e0c-9abc-41ef-b47c-9daa472916bf None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.280992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d2e0c-9abc-41ef-b47c-9daa472916bf None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.282271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 529/1050] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:14.282512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 522/1051] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:48:14.287999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.288341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.288557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.288730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d2e0c-9abc-41ef-b47c-9daa472916bf None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:14.309196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:14.310393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:14.384654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 530/1052] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:14.414050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d2e0c-9abc-41ef-b47c-9daa472916bf None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:14.453538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.454157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.454448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.454727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.455608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] RBAC: Adding query filter params (role.id=c11623614d8f4c64bff683d6faceefc5, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=28f32f08ac32498ba75eb4faa022f464) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:14.456234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:14.457708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:14.472024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 523/1053] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:14 2022] GET /identity/v3/role_assignments?user.id=28f32f08ac32498ba75eb4faa022f464&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=c11623614d8f4c64bff683d6faceefc5 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:14.656644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:14.707087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:14.775130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3923d51-c129-4478-82d1-17b04a8000d7 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:14.814390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.815133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.815453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.815683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.826196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:14.832548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:14.834411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:14.836479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 531/1054] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:14.841277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:14.908183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:14.954341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aab6d2-a0d2-4f92-919d-eaf609e5e992 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.009403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.010065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.010346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.010667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.011407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:15.011703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.013198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.030953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 524/1055] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:15.032729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.164660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9d70-924f-4469-b3c6-250658a9d753 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.166772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:15.210976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.211711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.211988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.212256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] PATH_INFO: `/v3/users/35ad87c80ded45458b5dfaf5e6f704ab` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.228451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] RBAC: Authorizing `identity:get_user(user_id=35ad87c80ded45458b5dfaf5e6f704ab)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.230284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.232236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 532/1056] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/users/35ad87c80ded45458b5dfaf5e6f704ab => generated 285 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:15.238264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.358065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e186f54-6cbe-479c-9416-ad2d994e9d38 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.384699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:15.399840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.400738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.401083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.401375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.483635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.484992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.610036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 525/1057] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:15.612425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.745157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d2de-66ee-4e92-a462-da37afce0350 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.799353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666893-eba2-4045-9ffc-e4237e9ebc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.800215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666893-eba2-4045-9ffc-e4237e9ebc59 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.800494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666893-eba2-4045-9ffc-e4237e9ebc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.800886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666893-eba2-4045-9ffc-e4237e9ebc59 None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.802128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666893-eba2-4045-9ffc-e4237e9ebc59 None admin] RBAC: Authorizing `identity:get_project(project_id=e2488a1bfae741c184fa2ebec3190e3e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.803708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666893-eba2-4045-9ffc-e4237e9ebc59 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.810615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 533/1058] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:15.814637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.840011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:15.930580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8fc8b-3d3c-43ff-9018-38f90bb2cebe None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.982826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.983464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.983745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.984020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.984751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=e2488a1bfae741c184fa2ebec3190e3e, user.id=35ad87c80ded45458b5dfaf5e6f704ab) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:15.985059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.986516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318be12c-0d3b-4e8c-868c-0fec5db2c3e3 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.998242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 526/1059] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/role_assignments?user.id=35ad87c80ded45458b5dfaf5e6f704ab&scope.project.id=e2488a1bfae741c184fa2ebec3190e3e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:16.130039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8623b-b65d-4f6b-a8fa-c9f563de334c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:16.130817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8623b-b65d-4f6b-a8fa-c9f563de334c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:16.130817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8623b-b65d-4f6b-a8fa-c9f563de334c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:16.132340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 534/1060] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:16.138390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e81c-faff-4130-ad76-20bf320d1923 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:16.138991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e81c-faff-4130-ad76-20bf320d1923 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:16.139247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e81c-faff-4130-ad76-20bf320d1923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:16.166754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d384e81c-faff-4130-ad76-20bf320d1923 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:16.168078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d384e81c-faff-4130-ad76-20bf320d1923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:16.264102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 527/1061] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:16.428320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f887b-d0c1-414a-9ad8-df1bf4085fd0 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:16.428794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f887b-d0c1-414a-9ad8-df1bf4085fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:16.429152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f887b-d0c1-414a-9ad8-df1bf4085fd0 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:16.434946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 535/1062] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:16.436694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:16.437219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:16.437672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:16.469678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:16.471151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:16.493469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:16.546426 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f887b-d0c1-414a-9ad8-df1bf4085fd0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:16.568955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 528/1063] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:16.590509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:16.680849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f887b-d0c1-414a-9ad8-df1bf4085fd0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:16.728918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:16.730352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:16.731044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:16.731793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:16.817038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:16.818914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:16.847118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:16.853850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:16.935103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 536/1064] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:16.938510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:16.972993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c0a22-2b76-42df-96ea-c1afe3a41af4 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.027395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.028308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.028749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.029165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.046692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:17.054708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:17.055775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:17.056652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 529/1065] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 09:48:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:17.062482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:17.067411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1654c-4fe3-4ff1-a71a-f49e63e89ccc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.075635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:17.107287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:17.117510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.118191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.118470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.118736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.130348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.131914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:17.149211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:17.150633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:17.154467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:17.154467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:17.154467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:17.154467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 537/1066] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:17.157289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:17.191708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0069b-b414-434b-be83-81da44a268b8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.233555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.234567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.235062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.235444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.236167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:17.236532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.238122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:17.251419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 530/1067] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:48:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:17.254558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:17.288979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc756ce0-2b38-4fd3-a242-ded99e8b6e1f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.330691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.331703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.331983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.332246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.332925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:17.333247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.334620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:17.335666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:17.359103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 538/1068] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:17.376196 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dd9b3-de60-4ee4-862c-6fad410942f8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.420956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.421625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.421904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.422185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.435407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.437077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:17.453920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:17.455013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:17.456035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:17.456035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:17.456035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:17.456035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 531/1069] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:17.465168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:17.518981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:17.593390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9b4d2-827a-4b05-948f-efb00900addc None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.635943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.636562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.636829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.637109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.637754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:17.638320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.639671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:17.653357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 539/1070] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:17.659946 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:17.778992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb8da0-72ec-4178-ad2f-dff976d4b762 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.803885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:17.818799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.819519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.819794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.820078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.828820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.830335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-afddeadd-8188-4c7c-b702-ac14ed85ae8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:48:17.842727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:17.843901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:17.844911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 532/1071] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:48:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:17.850305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:17.951440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:17.954954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508f8a-b3b1-47b1-bba5-51f0fd0ae88b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:17.990880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:17.991526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:17.991806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:17.992081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:17.992827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:17.993129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:17.994557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c60f6a-b6e6-480d-b511-3e1286e2f188 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.012966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6f140-b402-4470-a839-259d5e508a7d None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.013813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6f140-b402-4470-a839-259d5e508a7d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.013813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6f140-b402-4470-a839-259d5e508a7d None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.014790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 540/1072] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:48:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:18.015073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 533/1073] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:18.020924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.021317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.021649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.021826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6f140-b402-4470-a839-259d5e508a7d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.045001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:18.046390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:18.127625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 541/1074] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:18.151913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6f140-b402-4470-a839-259d5e508a7d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.188511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.189175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.189440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.189715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.200323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.201894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:18.222158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:18.223170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:18.224277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:18.224277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:18.224277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:18.224277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 534/1075] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:18.229666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.324096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:18.338343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6261-9955-4568-af4a-be9aa2888a41 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.374557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.375338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.375615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.375884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.376531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:18.376833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.378477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.392189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 542/1076] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:18.398426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.405295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.437586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:18.513502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b5112-ab12-48d9-b07a-08c28d2b0028 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.517496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac0f5b-ce8d-4e89-9555-091e90b7c261 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.560666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.560987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.561363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.561525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.561674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.561817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.561925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.562102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.571186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.572636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.578123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:18.583924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:18.585489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:18.587032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:48:18.587902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:18.588877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:18.589834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 535/1077] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:18.590470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 543/1078] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:18.591700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.595342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.609632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:18.698287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:18.705461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214e0bf-3dc7-4144-bd99-ddab3abe5fcc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.713441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cc408-4849-4dee-baab-707d2725709d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.746017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.746641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.746933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.747218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.747887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:18.748182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.749562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.752481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.753402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.753783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.754147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.754872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:18.755211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.756673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.760126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 536/1079] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:18.766504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.770153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 544/1080] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:18.776247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.853936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:18.881669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20622074-3162-4a8a-925b-9c7284f36cff None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.899884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d864-fed5-46dc-b29f-7de74da5c488 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:18.927229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.927870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.928149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.928466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] PATH_INFO: `/v3/users/35ad87c80ded45458b5dfaf5e6f704ab` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.930197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] RBAC: Authorizing `identity:get_user(user_id=35ad87c80ded45458b5dfaf5e6f704ab)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.931916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.934596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 537/1081] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/users/35ad87c80ded45458b5dfaf5e6f704ab => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:18.940818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:18.943608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:18.944884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:18.944884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:18.944884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/28f32f08ac32498ba75eb4faa022f464/roles/c11623614d8f4c64bff683d6faceefc5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:18.948466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=28f32f08ac32498ba75eb4faa022f464, role_id=c11623614d8f4c64bff683d6faceefc5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:18.949968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:18.970304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 545/1082] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:48:18 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/28f32f08ac32498ba75eb4faa022f464/roles/c11623614d8f4c64bff683d6faceefc5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:18.977512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:19.077352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974e0c1-c626-47a1-8bf8-2a970a4a8946 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:19.123536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2584b5f-13bc-40fe-963e-cb965e2c1644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:19.124194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2584b5f-13bc-40fe-963e-cb965e2c1644 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:19.124466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2584b5f-13bc-40fe-963e-cb965e2c1644 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:19.124770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2584b5f-13bc-40fe-963e-cb965e2c1644 None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:19.126058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2584b5f-13bc-40fe-963e-cb965e2c1644 None admin] RBAC: Authorizing `identity:get_project(project_id=e2488a1bfae741c184fa2ebec3190e3e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:19.127573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2584b5f-13bc-40fe-963e-cb965e2c1644 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:19.129468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 538/1083] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:18 2022] GET /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:19.136307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:19.273179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79020bd9-3b64-419f-936a-0459c6870af6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:19.313008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:19.329471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50199-32cf-46a7-8bfd-beb2e9ed29a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:19.330450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50199-32cf-46a7-8bfd-beb2e9ed29a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:19.330730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50199-32cf-46a7-8bfd-beb2e9ed29a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:19.331103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50199-32cf-46a7-8bfd-beb2e9ed29a8 None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e/users/35ad87c80ded45458b5dfaf5e6f704ab/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:19.334573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50199-32cf-46a7-8bfd-beb2e9ed29a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2488a1bfae741c184fa2ebec3190e3e, user_id=35ad87c80ded45458b5dfaf5e6f704ab, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:19.337231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50199-32cf-46a7-8bfd-beb2e9ed29a8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:19.355332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 546/1084] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:48:19 2022] PUT /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e/users/35ad87c80ded45458b5dfaf5e6f704ab/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:20.940027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd820e8-dabe-4ea0-a9ee-00d3e6e4eac2 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:20.940587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd820e8-dabe-4ea0-a9ee-00d3e6e4eac2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:20.940587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd820e8-dabe-4ea0-a9ee-00d3e6e4eac2 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:20.942156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 539/1085] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:20.947637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029eae-be54-41bb-badb-81643d9b7f3c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:20.948091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029eae-be54-41bb-badb-81643d9b7f3c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:20.948197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029eae-be54-41bb-badb-81643d9b7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:20.969502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-12029eae-be54-41bb-badb-81643d9b7f3c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:20.970675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-12029eae-be54-41bb-badb-81643d9b7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:21.045551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 547/1086] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:21.281457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347574d-e8b0-46f2-82bd-8bf695fd2ec5 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.281775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347574d-e8b0-46f2-82bd-8bf695fd2ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.281994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347574d-e8b0-46f2-82bd-8bf695fd2ec5 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.283560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 540/1087] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:21.289340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.289636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.289913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.308568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:21.309773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:21.320054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347574d-e8b0-46f2-82bd-8bf695fd2ec5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.384941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 548/1088] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:21.439634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:21.450510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347574d-e8b0-46f2-82bd-8bf695fd2ec5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.485331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.485888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.486168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.486438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.498465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:21.503579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:21.504514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:21.505343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 541/1089] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:21.510966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.564936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:21.627437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864243c5-ba5c-4f4d-a61f-8e98e3fd0959 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.664316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.664924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.665201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.665473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.666547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:21.666851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.668267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.672373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.682243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 549/1090] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:21.689770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.795178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ddf3-dfbe-4c1a-9300-a54a0ccf9a78 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.821481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edfe70-ec75-46b8-84e2-6e4df2bd4f91 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.832701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:21.836317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.837108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.837385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.837650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.848787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:21.853358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:21.855207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:21.856804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 542/1091] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:21.859160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.859732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.860005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.860269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.863732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.873198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.874656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.882562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:21.893132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:21.894239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:21.895169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:21.895169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:21.895169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:21.895169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 550/1092] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:21.900558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.989482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074df0-f33d-4ffc-98a5-e8edc87483c4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.029190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a296d-353e-450d-a534-95ae4330eaba None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.029800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.030241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.030556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.030815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.031521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:22.031821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.033209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.044963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 543/1093] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:22.052363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.070035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.070913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.071271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.071543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.072368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:22.072673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.074067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.092677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 551/1094] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:22.094547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.122183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.141228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.183972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d64912-4f7c-41e4-8595-b475cb9a46ac None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.228033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdaa31-b0ea-4758-8756-6b8feac255cd None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.230245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.230883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.231259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.231572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] PATH_INFO: `/v3/users/35ad87c80ded45458b5dfaf5e6f704ab` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.232848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] RBAC: Authorizing `identity:get_user(user_id=35ad87c80ded45458b5dfaf5e6f704ab)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.234313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.235949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 544/1095] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/users/35ad87c80ded45458b5dfaf5e6f704ab => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:22.242370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.276857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.277840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.278324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.278772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.291325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.293585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:48:22.312445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:22.313721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:22.314991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 552/1096] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:22.320363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.372051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503be42-ea72-44db-b100-f1b2019a2fae None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.413722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.426856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.427935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.427935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.428270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.436600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58944689-eb11-496e-912f-adeb91da76ed None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.441346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.486113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.487550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.487850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.488140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.488885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:22.489184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.493673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.507553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.509032 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.514729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 553/1097] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:22.520687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.631251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 545/1098] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:48:22.637368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.645692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59064f-fc1a-4af9-a99a-4a9be365c0b5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.682965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.685389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.686131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.686486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.686984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.701267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.749208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76447946-1a5c-4da7-8f5d-3ac6cd2fe1b2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.776378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.777844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.787998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.789037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.789518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.789960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.791601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e2488a1bfae741c184fa2ebec3190e3e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.793766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.796173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 546/1099] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:22.804112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.905313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 554/1100] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:48:22.911281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:22.918246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc42eef-0b16-4643-93fe-f523932ed0e2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:22.932214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.965437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:22.970076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:22.971122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:22.971591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:22.972050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:22.973463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=e2488a1bfae741c184fa2ebec3190e3e, user.id=35ad87c80ded45458b5dfaf5e6f704ab) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:22.973987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:22.976596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:22.986217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 547/1101] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/role_assignments?user.id=35ad87c80ded45458b5dfaf5e6f704ab&scope.project.id=e2488a1bfae741c184fa2ebec3190e3e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:23.044746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a215a-a5fe-41bc-bab0-b40b8bc7ced4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:23.088132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:23.088811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:23.089087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:23.089355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:23.104795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:23.106295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:23.123270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:23.124888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:48:23.125875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:23.125875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:48:23.125875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:23.125875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 555/1102] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:48:23.132572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:23.278425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0191df9-e4ec-4d76-bf1e-7d552b6a949b None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:23.322539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:23.323185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:23.323467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:23.323739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:23.324386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:23.324690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:23.326067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:23.339972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 548/1103] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:23.345819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:23.440084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:23.449880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0e4f5-2da4-4a8e-8710-6cc7e947024f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:23.494814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:23.495571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:23.495936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:23.496317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:23.504779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:23.506268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:48:23.517773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:23.518685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:23.519959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 556/1104] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:23.525079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:23.563313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:23.641634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bf148-c8f1-4989-b492-cc139f1cdfc7 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:23.683473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:23.684090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:23.684435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:23.684641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:23.685342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:23.685647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:23.687077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e9586-ee69-4d51-894e-ffee10cb4377 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:23.700006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 549/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:23.708281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:23.820688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba81a-0959-4523-8f26-8041421b359e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:23.859281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:23.859884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:23.860155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:23.860421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:23.861148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] RBAC: Adding query filter params (role.id=c11623614d8f4c64bff683d6faceefc5, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=28f32f08ac32498ba75eb4faa022f464) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:23.861450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:23.862947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c2103-839b-4503-bd77-4beff780edf5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:23.868943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 557/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:23 2022] GET /identity/v3/role_assignments?user.id=28f32f08ac32498ba75eb4faa022f464&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=c11623614d8f4c64bff683d6faceefc5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:25.020709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07812-41ee-4767-bf3c-2fee64452b48 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:25.021278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07812-41ee-4767-bf3c-2fee64452b48 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:25.021278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07812-41ee-4767-bf3c-2fee64452b48 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:25.022605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 550/1107] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:25.028282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:25.028743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:25.028837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:25.048210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:25.049423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:25.061163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:25.124580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 558/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:25.396251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07812-41ee-4767-bf3c-2fee64452b48 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:25.498109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:25.511069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07812-41ee-4767-bf3c-2fee64452b48 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:25.560818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65f4d-c599-4cc0-b3d4-8a8b5a7a6e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:25.561460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65f4d-c599-4cc0-b3d4-8a8b5a7a6e0b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:25.561735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65f4d-c599-4cc0-b3d4-8a8b5a7a6e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:25.562000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65f4d-c599-4cc0-b3d4-8a8b5a7a6e0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:25.563209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65f4d-c599-4cc0-b3d4-8a8b5a7a6e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:25.564662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65f4d-c599-4cc0-b3d4-8a8b5a7a6e0b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:25.566366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 551/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:25.572911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:25.702435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac406ac-9b09-4bba-b52b-249b0de92ee0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:25.741343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b4a37-a255-452a-a61c-aac31af68db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:25.741952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b4a37-a255-452a-a61c-aac31af68db6 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:25.742225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b4a37-a255-452a-a61c-aac31af68db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:25.742494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b4a37-a255-452a-a61c-aac31af68db6 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:25.743166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b4a37-a255-452a-a61c-aac31af68db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:25.744594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b4a37-a255-452a-a61c-aac31af68db6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:25.768593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 559/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:48:25 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:27.776556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc19c0-cb41-45dc-8f27-ee16c846eb6f None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:27.777105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc19c0-cb41-45dc-8f27-ee16c846eb6f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:27.777105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc19c0-cb41-45dc-8f27-ee16c846eb6f None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:27.778467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 552/1111] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:27.784310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:27.784752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:27.784864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:27.791384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:27.806137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:27.807367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:27.881798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 560/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:28.148235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc19c0-cb41-45dc-8f27-ee16c846eb6f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:28.287862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc19c0-cb41-45dc-8f27-ee16c846eb6f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:28.326914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:28.327708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:28.327982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:28.328255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] PATH_INFO: `/v3/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:28.329643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] RBAC: Authorizing `identity:get_role(role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:28.331033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:28.332402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 553/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:28 2022] GET /identity/v3/roles/e748222847a44424b09a5d0be46f4c05 => generated 223 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:28.338922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:28.441635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1dbd-4436-4a24-bce5-c228f2717b8d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:28.473822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:28.479686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:28.480323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:28.480597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:28.480870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] PATH_INFO: `/v3/users/028cf80722a84367a355a2d02ff489ee` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:28.494596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] RBAC: Authorizing `identity:get_user(user_id=028cf80722a84367a355a2d02ff489ee)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:28.496086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:28.497741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 561/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:28 2022] GET /identity/v3/users/028cf80722a84367a355a2d02ff489ee => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:28.503723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:28.534875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:28.608235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085c49c-7322-4992-aa88-1a3d4228d80e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:28.649129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:28.649728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:28.649999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:28.650267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:28.720843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:28.722217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:28.753254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:28.826028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 554/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:28.832753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:28.937703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a61de-8194-4491-9e6e-e550d8362688 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:28.972469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc331-4c88-4ebb-96cc-496d9848dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:28.973061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc331-4c88-4ebb-96cc-496d9848dfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:28.973335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc331-4c88-4ebb-96cc-496d9848dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:28.973608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc331-4c88-4ebb-96cc-496d9848dfa3 None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:28.975075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc331-4c88-4ebb-96cc-496d9848dfa3 None admin] RBAC: Authorizing `identity:get_project(project_id=e2488a1bfae741c184fa2ebec3190e3e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:28.976535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc331-4c88-4ebb-96cc-496d9848dfa3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:28.978191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 562/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:28 2022] GET /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:28.984606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:29.090034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc017dd-20df-4f7c-aece-e7245d7d4dfc None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:29.119884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:29.127968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:29.128589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:29.128871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:29.129145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:29.129967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] RBAC: Adding query filter params (role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=e2488a1bfae741c184fa2ebec3190e3e, user.id=028cf80722a84367a355a2d02ff489ee) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:29.130275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:29.131792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754acbef-e2ed-4f91-8471-cd860136f369 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:29.137675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 555/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:28 2022] GET /identity/v3/role_assignments?user.id=028cf80722a84367a355a2d02ff489ee&scope.project.id=e2488a1bfae741c184fa2ebec3190e3e&role.id=e748222847a44424b09a5d0be46f4c05 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:31.024641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1170-3eb0-4418-aff3-9404657544c0 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:31.025232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1170-3eb0-4418-aff3-9404657544c0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:31.025232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1170-3eb0-4418-aff3-9404657544c0 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:31.026507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 563/1118] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:31.031969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:31.032429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:31.032521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:31.052074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:31.053263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:31.127067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 556/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:31.388658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1170-3eb0-4418-aff3-9404657544c0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:31.454579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:31.502656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1170-3eb0-4418-aff3-9404657544c0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:31.539925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:31.540562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:31.540843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:31.541114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] PATH_INFO: `/v3/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:31.542640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] RBAC: Authorizing `identity:get_role(role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:31.544070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:31.545433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 564/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:31 2022] GET /identity/v3/roles/e748222847a44424b09a5d0be46f4c05 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:31.551679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:31.672822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df3ce2-f958-4d29-b7c6-b58d953491c7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:31.698026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:31.709999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:31.710642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:31.710922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:31.711221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] PATH_INFO: `/v3/users/028cf80722a84367a355a2d02ff489ee` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:31.712360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] RBAC: Authorizing `identity:get_user(user_id=028cf80722a84367a355a2d02ff489ee)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:31.713810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:31.715458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 557/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:31 2022] GET /identity/v3/users/028cf80722a84367a355a2d02ff489ee => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:31.722861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:31.841769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee655c7-b118-4419-8000-3a6c1a674e9c None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:31.881136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:31.891428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9611a5-a964-4781-9ade-929c987ffb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:31.892065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9611a5-a964-4781-9ade-929c987ffb5f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:31.892339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9611a5-a964-4781-9ade-929c987ffb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:31.892606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9611a5-a964-4781-9ade-929c987ffb5f None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:31.893748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9611a5-a964-4781-9ade-929c987ffb5f None admin] RBAC: Authorizing `identity:get_project(project_id=e2488a1bfae741c184fa2ebec3190e3e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:31.895335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9611a5-a964-4781-9ade-929c987ffb5f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:31.897101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 565/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:31 2022] GET /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:31.903420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:32.032670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23c385-1c9b-4e49-b779-685ebbbb3da3 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:32.069694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a4871-2c10-4659-af6f-08cb91e2afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:32.070360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4871-2c10-4659-af6f-08cb91e2afd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:32.070638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4871-2c10-4659-af6f-08cb91e2afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:32.070912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4871-2c10-4659-af6f-08cb91e2afd2 None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e/users/028cf80722a84367a355a2d02ff489ee/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:32.073294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a4871-2c10-4659-af6f-08cb91e2afd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2488a1bfae741c184fa2ebec3190e3e, user_id=028cf80722a84367a355a2d02ff489ee, role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:32.074744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a4871-2c10-4659-af6f-08cb91e2afd2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:32.090121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 558/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:48:31 2022] PUT /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e/users/028cf80722a84367a355a2d02ff489ee/roles/e748222847a44424b09a5d0be46f4c05 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:33.990178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c8e6d-2914-45c6-a475-d0b2b471003a None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:33.990738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c8e6d-2914-45c6-a475-d0b2b471003a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:33.990738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c8e6d-2914-45c6-a475-d0b2b471003a None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:33.992186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 566/1124] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:33.997745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:33.998198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:33.998289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:34.017264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:34.018452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:34.066688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:34.088125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 559/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:34.349619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c8e6d-2914-45c6-a475-d0b2b471003a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:34.456817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c8e6d-2914-45c6-a475-d0b2b471003a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:34.493327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:34.493986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:34.494266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:34.494527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] PATH_INFO: `/v3/roles/e748222847a44424b09a5d0be46f4c05` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:34.496043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] RBAC: Authorizing `identity:get_role(role_id=e748222847a44424b09a5d0be46f4c05)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:34.497460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:34.498864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 567/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:34 2022] GET /identity/v3/roles/e748222847a44424b09a5d0be46f4c05 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:34.505400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:34.608035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b1dd-c453-4a0f-917a-5b20d39a1d8f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:34.642440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:34.643096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:34.643373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:34.643643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] PATH_INFO: `/v3/users/028cf80722a84367a355a2d02ff489ee` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:34.644757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] RBAC: Authorizing `identity:get_user(user_id=028cf80722a84367a355a2d02ff489ee)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:34.646773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:34.648414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 560/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:34 2022] GET /identity/v3/users/028cf80722a84367a355a2d02ff489ee => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:34.654406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:34.727600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:34.768896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729e303-b451-4fa0-982b-fcaa7d305fe3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:34.805314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:34.805920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:34.806197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:34.806460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:34.875741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:34.876888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:34.939942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:34.982038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 568/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:34.988637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:35.041859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:35.096319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb06f-b487-4afa-b835-d43bd3d462cb None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:35.134057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7b9a5-2721-45ef-846a-afe8185cd92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:35.134603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7b9a5-2721-45ef-846a-afe8185cd92b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:35.134907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7b9a5-2721-45ef-846a-afe8185cd92b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:35.135212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7b9a5-2721-45ef-846a-afe8185cd92b None admin] PATH_INFO: `/v3/projects/e2488a1bfae741c184fa2ebec3190e3e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:35.136343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7b9a5-2721-45ef-846a-afe8185cd92b None admin] RBAC: Authorizing `identity:get_project(project_id=e2488a1bfae741c184fa2ebec3190e3e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:35.137788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7b9a5-2721-45ef-846a-afe8185cd92b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:35.139533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 561/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:34 2022] GET /identity/v3/projects/e2488a1bfae741c184fa2ebec3190e3e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:35.146611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:35.284262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9418872-4f89-4c41-ab0f-e6ccd9aa61e5 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:35.324042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:35.324773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:35.325168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:35.325532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:35.326366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] RBAC: Adding query filter params (role.id=e748222847a44424b09a5d0be46f4c05, scope.project.id=e2488a1bfae741c184fa2ebec3190e3e, user.id=028cf80722a84367a355a2d02ff489ee) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:35.326761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:35.328352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a183-3050-4045-8d4e-e2f0f0c365fa None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:35.335449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 569/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:35 2022] GET /identity/v3/role_assignments?user.id=028cf80722a84367a355a2d02ff489ee&scope.project.id=e2488a1bfae741c184fa2ebec3190e3e&role.id=e748222847a44424b09a5d0be46f4c05 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:37.304182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f84c-5e74-42d3-a52d-791aa8faea69 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:37.304742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f84c-5e74-42d3-a52d-791aa8faea69 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:37.304742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f84c-5e74-42d3-a52d-791aa8faea69 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:37.306162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 562/1131] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:37.312887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:37.313458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:37.313580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:37.335085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:37.336299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:37.358556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:37.411026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 570/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:37.675907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f84c-5e74-42d3-a52d-791aa8faea69 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:37.785341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f84c-5e74-42d3-a52d-791aa8faea69 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:37.803817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:37.822233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31e97-79cc-4129-816d-42e1945abdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:37.822862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31e97-79cc-4129-816d-42e1945abdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:37.823171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31e97-79cc-4129-816d-42e1945abdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:37.823447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31e97-79cc-4129-816d-42e1945abdb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:37.824550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd31e97-79cc-4129-816d-42e1945abdb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:37.826013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd31e97-79cc-4129-816d-42e1945abdb4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:37.827619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 563/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:37.835352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:37.947611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ee7b9-e840-4dee-a35b-b4644907d186 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:37.982980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd843c-ba12-4794-acae-a4a1a4d270b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:37.983636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd843c-ba12-4794-acae-a4a1a4d270b6 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:37.983896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd843c-ba12-4794-acae-a4a1a4d270b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:37.984160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd843c-ba12-4794-acae-a4a1a4d270b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:37.984814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd843c-ba12-4794-acae-a4a1a4d270b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:37.986253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd843c-ba12-4794-acae-a4a1a4d270b6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:38.018559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 571/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:48:37 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:39.989211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f397-d700-46e5-a58b-fe1a17070983 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:39.990147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f397-d700-46e5-a58b-fe1a17070983 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:39.990147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f397-d700-46e5-a58b-fe1a17070983 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:39.992149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 564/1135] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:39.999004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:39.999507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:39.999598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:40.018567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:40.020047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:40.022011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:40.106082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 572/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:40.401256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f397-d700-46e5-a58b-fe1a17070983 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:40.508095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11f397-d700-46e5-a58b-fe1a17070983 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:40.547295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5da44d-5fd4-49db-970d-aef2e310828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:40.548139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5da44d-5fd4-49db-970d-aef2e310828b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:40.548533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5da44d-5fd4-49db-970d-aef2e310828b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:40.548909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5da44d-5fd4-49db-970d-aef2e310828b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:40.550511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5da44d-5fd4-49db-970d-aef2e310828b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:40.552637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5da44d-5fd4-49db-970d-aef2e310828b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:40.555005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 565/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:48:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:40.563242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:40.672641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7e157-2750-4b0d-b750-f472443b8f47 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:40.711427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a39e22-da8d-4528-bf43-8ffe47af20fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:40.712053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39e22-da8d-4528-bf43-8ffe47af20fb None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:40.712328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39e22-da8d-4528-bf43-8ffe47af20fb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:40.712598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a39e22-da8d-4528-bf43-8ffe47af20fb None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:40.713239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a39e22-da8d-4528-bf43-8ffe47af20fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:40.714705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a39e22-da8d-4528-bf43-8ffe47af20fb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:40.725319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:40.748531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 573/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:48:40 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:42.762708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273cd08-d516-4875-926d-70051fb4596e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:42.763401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273cd08-d516-4875-926d-70051fb4596e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:42.763401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273cd08-d516-4875-926d-70051fb4596e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:42.764732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 566/1139] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:42.772926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:42.773354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:42.773472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:42.795029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:42.796326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:42.875395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 574/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:43.156382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273cd08-d516-4875-926d-70051fb4596e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:43.223692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:43.274724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273cd08-d516-4875-926d-70051fb4596e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:43.314254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:43.314887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:43.315201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:43.315474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:43.326311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:43.331172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:43.332933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:43.334190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 567/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:43.339680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:43.447520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47e72-b16b-47bf-9a75-70a8164bd16a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:43.473257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:43.488340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:43.488971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:43.489249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:43.489519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:43.490201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:43.490501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:43.492039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:43.500970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 575/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:43.508813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:43.640150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5362-1009-4092-b4cc-d802642134d8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:43.655698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:43.679837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:43.680488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:43.680769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:43.681041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] PATH_INFO: `/v3/users/823a09be494a4ed09f3dcc2e1a3a8570` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:43.696129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] RBAC: Authorizing `identity:get_user(user_id=823a09be494a4ed09f3dcc2e1a3a8570)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:43.697658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:43.699369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 568/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:43 2022] GET /identity/v3/users/823a09be494a4ed09f3dcc2e1a3a8570 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:43.705380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:43.826603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a12f6-9c99-4c51-be5c-b63fd2cf310e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:43.869448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:43.870059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:43.870412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:43.870685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:43.935847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:43.949800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:43.951191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:44.068100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 576/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:44.074412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:44.196506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95c9f-fef6-4326-aba0-9106226692b6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:44.237782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6b53c-1104-48f0-93ff-58f59a523777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:44.238701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b53c-1104-48f0-93ff-58f59a523777 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:44.239167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b53c-1104-48f0-93ff-58f59a523777 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:44.239557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b53c-1104-48f0-93ff-58f59a523777 None admin] PATH_INFO: `/v3/projects/c140336cbc004df6b237fc2b1b33af82` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:44.242093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b53c-1104-48f0-93ff-58f59a523777 None admin] RBAC: Authorizing `identity:get_project(project_id=c140336cbc004df6b237fc2b1b33af82)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:44.244425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b53c-1104-48f0-93ff-58f59a523777 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:44.246970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 569/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:44 2022] GET /identity/v3/projects/c140336cbc004df6b237fc2b1b33af82 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:44.254111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:44.361529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:44.377181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee65a3-11af-4c78-8c2a-c03b7faebee6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:44.421421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:44.422025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:44.422309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:44.422580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:44.423378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=c140336cbc004df6b237fc2b1b33af82, user.id=823a09be494a4ed09f3dcc2e1a3a8570) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:44.423687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:44.425177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51cf28-ab45-4f0f-ab5f-5803bf68c114 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:44.431198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 577/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:44 2022] GET /identity/v3/role_assignments?user.id=823a09be494a4ed09f3dcc2e1a3a8570&scope.project.id=c140336cbc004df6b237fc2b1b33af82&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:46.406829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c759-f715-4315-9b2f-3fae56f8a1e0 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:46.407521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c759-f715-4315-9b2f-3fae56f8a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:46.407521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c759-f715-4315-9b2f-3fae56f8a1e0 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:46.408741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 570/1147] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:46.414325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:46.414831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:46.414975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:46.434356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:46.435730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:46.539456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 578/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:46.819044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c759-f715-4315-9b2f-3fae56f8a1e0 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:46.872524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:46.940425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c759-f715-4315-9b2f-3fae56f8a1e0 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:46.981025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:46.981655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:46.981936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:46.982209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:46.995723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:47.000618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:47.002722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:47.004851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 571/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:47.010977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:47.101270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:47.123907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e96e58-1114-4de8-b016-1d6a8fdc25c9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:47.165884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:47.166504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:47.166780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:47.167077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:47.167762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:47.168061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:47.169447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:47.178091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 579/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:47.184893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:47.297889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:47.301455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398b9f2-7c43-4b3d-ad59-14868e5a6163 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:47.339711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:47.340345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:47.340624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:47.340898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] PATH_INFO: `/v3/users/823a09be494a4ed09f3dcc2e1a3a8570` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:47.342046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] RBAC: Authorizing `identity:get_user(user_id=823a09be494a4ed09f3dcc2e1a3a8570)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:47.343529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:47.345377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 572/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:47 2022] GET /identity/v3/users/823a09be494a4ed09f3dcc2e1a3a8570 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:47.352880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:47.462124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50369db2-7f8d-4e61-8269-8c36f77324cf None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:47.509750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1840ce-ed43-4834-b32b-acff28b1d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:47.510382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1840ce-ed43-4834-b32b-acff28b1d122 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:47.510660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1840ce-ed43-4834-b32b-acff28b1d122 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:47.510927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1840ce-ed43-4834-b32b-acff28b1d122 None admin] PATH_INFO: `/v3/projects/c140336cbc004df6b237fc2b1b33af82` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:47.512087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1840ce-ed43-4834-b32b-acff28b1d122 None admin] RBAC: Authorizing `identity:get_project(project_id=c140336cbc004df6b237fc2b1b33af82)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:47.513552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1840ce-ed43-4834-b32b-acff28b1d122 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:47.515238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 580/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:47 2022] GET /identity/v3/projects/c140336cbc004df6b237fc2b1b33af82 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:47.521997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:47.687537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c54d-1ae3-42aa-a19e-75c9a5c9264c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:47.743832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb975a-723e-475b-b942-9cd3adb14678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:47.744936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb975a-723e-475b-b942-9cd3adb14678 None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:47.745458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb975a-723e-475b-b942-9cd3adb14678 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:47.745999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb975a-723e-475b-b942-9cd3adb14678 None admin] PATH_INFO: `/v3/projects/c140336cbc004df6b237fc2b1b33af82/users/823a09be494a4ed09f3dcc2e1a3a8570/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:47.749540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb975a-723e-475b-b942-9cd3adb14678 None admin] RBAC: Authorizing `identity:create_grant(project_id=c140336cbc004df6b237fc2b1b33af82, user_id=823a09be494a4ed09f3dcc2e1a3a8570, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:47.752373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb975a-723e-475b-b942-9cd3adb14678 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:47.768980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 573/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:48:47 2022] PUT /identity/v3/projects/c140336cbc004df6b237fc2b1b33af82/users/823a09be494a4ed09f3dcc2e1a3a8570/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:49.762632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95a252-ceff-4bd9-940c-7cc9b49ad7ce None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:49.763252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95a252-ceff-4bd9-940c-7cc9b49ad7ce None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:49.763252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95a252-ceff-4bd9-940c-7cc9b49ad7ce None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:49.764778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 581/1154] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:49.770717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:49.771233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:49.771454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:49.791494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:49.792799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:49.819168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:49.870571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 574/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:50.158612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95a252-ceff-4bd9-940c-7cc9b49ad7ce None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.174822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:50.291704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95a252-ceff-4bd9-940c-7cc9b49ad7ce None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.339205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.339638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.339924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.340203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.350621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:48:50.355755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:50.357772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:48:50.359710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 582/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:50.363589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.489775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f36ef-d4f6-487d-afc1-7c6dded60a63 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.525582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.526253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.526573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.526888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.527624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:50.527962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:50.529382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:50.538159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 575/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:48:50.546399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.640373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:50.676216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7066cb-2ed3-479d-a8b6-fcf04b4bb3e3 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.725144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.725777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.726064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.726334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] PATH_INFO: `/v3/users/823a09be494a4ed09f3dcc2e1a3a8570` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.727882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] RBAC: Authorizing `identity:get_user(user_id=823a09be494a4ed09f3dcc2e1a3a8570)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:50.729527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:50.731240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 583/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/users/823a09be494a4ed09f3dcc2e1a3a8570 => generated 286 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:50.737462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.762073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:50.841012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c207d21-3fbc-4a77-9482-a046c7ddc83e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.875671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.876276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.876548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.876815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.953206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:50.954685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:50.977501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:51.055290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 576/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:51.066357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:51.189626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbfdf-91ad-4928-b05f-d4a6e8520c7b None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:51.226096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beee30-0132-419c-9443-7587f96b290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:51.226761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beee30-0132-419c-9443-7587f96b290a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:51.227067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beee30-0132-419c-9443-7587f96b290a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:51.227343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beee30-0132-419c-9443-7587f96b290a None admin] PATH_INFO: `/v3/projects/c140336cbc004df6b237fc2b1b33af82` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:51.228532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beee30-0132-419c-9443-7587f96b290a None admin] RBAC: Authorizing `identity:get_project(project_id=c140336cbc004df6b237fc2b1b33af82)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:51.229978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beee30-0132-419c-9443-7587f96b290a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:51.231652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 584/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:48:51 2022] GET /identity/v3/projects/c140336cbc004df6b237fc2b1b33af82 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:51.238052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:51.342798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a8db3-d285-46d0-a63b-6a4686f5f8b0 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:51.363121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:51.395217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:51.395835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:51.396121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:51.396396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:51.397138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=c140336cbc004df6b237fc2b1b33af82, user.id=823a09be494a4ed09f3dcc2e1a3a8570) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:51.397446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:51.399103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c16d1-8237-408f-ab8b-9bf49b38d18b None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:51.406591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 577/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:48:51 2022] GET /identity/v3/role_assignments?user.id=823a09be494a4ed09f3dcc2e1a3a8570&scope.project.id=c140336cbc004df6b237fc2b1b33af82&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:53.384442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f8990-ba29-4c51-9851-fa446a1b7610 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:53.385054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f8990-ba29-4c51-9851-fa446a1b7610 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:53.385054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f8990-ba29-4c51-9851-fa446a1b7610 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:53.386382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 585/1162] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:53.392547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:53.392980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:53.393126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:53.418641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:53.419840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:53.489987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 578/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:53.755138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f8990-ba29-4c51-9851-fa446a1b7610 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:53.771397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:53.886961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f8990-ba29-4c51-9851-fa446a1b7610 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:53.925227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:53.925833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:53.926108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:53.926377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:54.009833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:54.011212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:54.020419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:54.141098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 586/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:48:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:48:54.147511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:54.261890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbfcc-bcb6-499a-86ae-3bf42d6f6134 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:54.279631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:54.301349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:54.301988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:54.302267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:54.302537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:54.310084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:54.311733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-899923da-56df-4cc0-afff-9302a5ca77e0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:48:54.324574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:48:54.326885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:48:54.328699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 579/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:48:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:48:54.332598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:54.461365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25194-855c-4ea7-a3c9-f6712b05c644 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:54.470872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:54.508209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:54.509458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:54.509733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:54.509997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:54.510699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:54.510981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:54.512543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf795a-8f5e-4672-969b-3204cc2ac2a3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:54.524002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 587/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Aug 24 09:48:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:56.456830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca73077-1f39-4b03-968f-c9b0e2cde9df None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:56.457366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca73077-1f39-4b03-968f-c9b0e2cde9df None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:56.457366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca73077-1f39-4b03-968f-c9b0e2cde9df None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:56.458901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 580/1167] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:56.465460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da5d8-58b4-4d8f-a7ba-4bf4191a1bfe None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:56.465961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da5d8-58b4-4d8f-a7ba-4bf4191a1bfe None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:56.466054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da5d8-58b4-4d8f-a7ba-4bf4191a1bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:56.487293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-852da5d8-58b4-4d8f-a7ba-4bf4191a1bfe None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:56.488499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-852da5d8-58b4-4d8f-a7ba-4bf4191a1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:56.563004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 588/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:48:56.830163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca73077-1f39-4b03-968f-c9b0e2cde9df None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:56.946809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca73077-1f39-4b03-968f-c9b0e2cde9df None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:56.984498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4d6e5-578f-40cc-a3a5-8fb1cd40917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:56.985139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4d6e5-578f-40cc-a3a5-8fb1cd40917c None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:56.985391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4d6e5-578f-40cc-a3a5-8fb1cd40917c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:56.985660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4d6e5-578f-40cc-a3a5-8fb1cd40917c None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:56.986335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4d6e5-578f-40cc-a3a5-8fb1cd40917c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:56.987762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4d6e5-578f-40cc-a3a5-8fb1cd40917c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:57.007681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 581/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Wed Aug 24 09:48:56 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:58.967687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6a62-9bff-4642-9e9a-c9b74ef95089 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:58.968267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6a62-9bff-4642-9e9a-c9b74ef95089 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:58.968368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6a62-9bff-4642-9e9a-c9b74ef95089 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:58.970650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 589/1170] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:48:58.976377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:58.976948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:58.976948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:58.995590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:58.996883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:59.025788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:59.074963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 582/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:48:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:48:59.358149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6a62-9bff-4642-9e9a-c9b74ef95089 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:59.467289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:59.472674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6a62-9bff-4642-9e9a-c9b74ef95089 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:59.511039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3fea-2f23-4bc6-a0dc-890657de5cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:59.511704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3fea-2f23-4bc6-a0dc-890657de5cac None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:59.511985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3fea-2f23-4bc6-a0dc-890657de5cac None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:59.512258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3fea-2f23-4bc6-a0dc-890657de5cac None admin] PATH_INFO: `/v3/domains/8c3a97b4739e4b76866dab38930ba457` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:59.522928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3fea-2f23-4bc6-a0dc-890657de5cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c3a97b4739e4b76866dab38930ba457)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:59.524708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3fea-2f23-4bc6-a0dc-890657de5cac None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:59.526491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 590/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Aug 24 09:48:59 2022] GET /identity/v3/domains/8c3a97b4739e4b76866dab38930ba457 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:59.532703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:59.642633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201b630-5359-4a55-b14d-2d37becd9f00 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:59.696875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19c23-c50b-4ea5-947c-99daa216a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:59.697765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19c23-c50b-4ea5-947c-99daa216a128 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:59.698188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19c23-c50b-4ea5-947c-99daa216a128 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:59.698581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19c23-c50b-4ea5-947c-99daa216a128 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:59.699579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b19c23-c50b-4ea5-947c-99daa216a128 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:59.701772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b19c23-c50b-4ea5-947c-99daa216a128 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:59.737276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 583/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:48:59 2022] POST /identity/v3/projects => generated 361 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:49:01.695003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ec24-9ce4-457d-ab86-79e3cedb228c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:01.695665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ec24-9ce4-457d-ab86-79e3cedb228c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:01.695665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ec24-9ce4-457d-ab86-79e3cedb228c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:01.697295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 591/1174] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:49:01.702753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:01.703211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:01.703330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:01.722193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:49:01.723435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:01.734609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:01.803857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 584/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:49:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:49:02.079781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ec24-9ce4-457d-ab86-79e3cedb228c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:02.212880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ec24-9ce4-457d-ab86-79e3cedb228c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:02.265986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945c56-ad4c-45ed-a666-1838f7d98789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:02.266623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945c56-ad4c-45ed-a666-1838f7d98789 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:02.266905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945c56-ad4c-45ed-a666-1838f7d98789 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:02.267213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945c56-ad4c-45ed-a666-1838f7d98789 None admin] PATH_INFO: `/v3/domains/8c3a97b4739e4b76866dab38930ba457` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:02.268396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945c56-ad4c-45ed-a666-1838f7d98789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c3a97b4739e4b76866dab38930ba457)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:02.269850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945c56-ad4c-45ed-a666-1838f7d98789 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:02.271498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 592/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Aug 24 09:49:02 2022] GET /identity/v3/domains/8c3a97b4739e4b76866dab38930ba457 => generated 267 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:02.280829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:02.401918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a12387-e94d-4fc3-9311-a1c0f326c608 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:02.438200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca717d-2e4a-47f3-bb0b-9f3fc946dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:02.438813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca717d-2e4a-47f3-bb0b-9f3fc946dad6 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:02.439253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca717d-2e4a-47f3-bb0b-9f3fc946dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:02.439555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca717d-2e4a-47f3-bb0b-9f3fc946dad6 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:02.440610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca717d-2e4a-47f3-bb0b-9f3fc946dad6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:02.442459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca717d-2e4a-47f3-bb0b-9f3fc946dad6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:02.464543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 585/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:49:02 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:49:04.509936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3d5f-57fc-4725-baf2-c43628114df7 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:04.510468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3d5f-57fc-4725-baf2-c43628114df7 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:04.510561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3d5f-57fc-4725-baf2-c43628114df7 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:04.512789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 593/1178] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:49:04.526477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:04.527029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:04.527029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:04.535547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:04.549354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:49:04.550553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:04.629719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 586/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:49:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:49:04.905436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3d5f-57fc-4725-baf2-c43628114df7 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:04.938066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:05.029773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3d5f-57fc-4725-baf2-c43628114df7 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:05.074940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:05.075775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:05.076056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:05.077411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:05.092501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:49:05.099256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:49:05.100292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:49:05.101840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 594/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:49:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:49:05.111035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:05.224852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7397cf-eae0-485b-a40c-c364e4adefbe None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:05.259155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:05.265023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:05.265655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:05.265924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:05.266193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:05.266866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:49:05.267205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:05.268588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:05.286580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 587/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:05.293148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:05.399321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:05.418469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f59bb-4822-4ef6-aaac-740371c834a4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:05.471143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:05.472126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:05.472613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:05.473055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] PATH_INFO: `/v3/users/97261be7502040a6843caa0dbb6d051f` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:05.492601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] RBAC: Authorizing `identity:get_user(user_id=97261be7502040a6843caa0dbb6d051f)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:05.494274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:05.495979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 595/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:49:05 2022] GET /identity/v3/users/97261be7502040a6843caa0dbb6d051f => generated 311 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:05.502191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:05.627499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbc91-b194-4549-a501-a382c047e3ae None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:05.670062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:05.670729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:05.671109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:05.671451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:05.739564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:05.747599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:05.749089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:05.874055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 588/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:49:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:49:05.880284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:05.997563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf075d-23bb-4dda-907b-b2e662922664 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:06.037062 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97bf6d-cd98-4165-a225-c2f18400d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:06.037903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97bf6d-cd98-4165-a225-c2f18400d60d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:06.038243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97bf6d-cd98-4165-a225-c2f18400d60d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:06.038529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97bf6d-cd98-4165-a225-c2f18400d60d None admin] PATH_INFO: `/v3/projects/a0ff5ebac97241d1bdc21088054ebf01` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:06.040138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97bf6d-cd98-4165-a225-c2f18400d60d None admin] RBAC: Authorizing `identity:get_project(project_id=a0ff5ebac97241d1bdc21088054ebf01)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:06.042460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97bf6d-cd98-4165-a225-c2f18400d60d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:06.044193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 596/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:49:05 2022] GET /identity/v3/projects/a0ff5ebac97241d1bdc21088054ebf01 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:06.050631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:06.147714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:06.155835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194ae7c-2b7a-4d31-b9a3-d7daaeb820ec None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:06.191942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:06.192773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:06.193107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:06.193107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:06.193780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a0ff5ebac97241d1bdc21088054ebf01, user.id=97261be7502040a6843caa0dbb6d051f) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:49:06.194088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:06.195593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be1d7e-e834-46e2-8675-a179d9bc09c6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:06.201560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 589/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:49:06 2022] GET /identity/v3/role_assignments?user.id=97261be7502040a6843caa0dbb6d051f&scope.project.id=a0ff5ebac97241d1bdc21088054ebf01&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:08.140595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9a0-c1c1-4484-b343-e8ceabc5346e None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:08.141162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9a0-c1c1-4484-b343-e8ceabc5346e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:08.141162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9a0-c1c1-4484-b343-e8ceabc5346e None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:08.142493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 597/1186] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:49:08.148046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:08.148663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:08.148663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:08.173259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:49:08.174464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:08.260645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 590/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:49:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:49:08.554877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9a0-c1c1-4484-b343-e8ceabc5346e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:08.572847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:08.693761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9a0-c1c1-4484-b343-e8ceabc5346e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:08.734734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:08.735419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:08.735888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:08.736409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:08.747586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:49:08.752237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:49:08.753352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:49:08.754227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 598/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:49:08.759671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:08.857838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:08.871040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18168e-a579-40af-b0ef-63373d19d071 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:08.907569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:08.908177 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:08.908451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:08.908695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:08.909414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:49:08.909687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:08.911110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:08.920133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 591/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:08.926258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:09.020560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:09.052863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5488507-663e-449d-b022-843056eca8a4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:09.099510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:09.100151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:09.100430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:09.100701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] PATH_INFO: `/v3/users/97261be7502040a6843caa0dbb6d051f` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:09.101854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] RBAC: Authorizing `identity:get_user(user_id=97261be7502040a6843caa0dbb6d051f)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:09.103338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:09.105552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 599/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:49:08 2022] GET /identity/v3/users/97261be7502040a6843caa0dbb6d051f => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:09.111832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:09.245666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320b8f6-577c-4ec8-a925-547c9cb75df4 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:09.283391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f550b-775f-4a83-8c88-8071e397f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:09.284144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f550b-775f-4a83-8c88-8071e397f143 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:09.284427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f550b-775f-4a83-8c88-8071e397f143 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:09.284709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f550b-775f-4a83-8c88-8071e397f143 None admin] PATH_INFO: `/v3/projects/a0ff5ebac97241d1bdc21088054ebf01` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:09.286039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f550b-775f-4a83-8c88-8071e397f143 None admin] RBAC: Authorizing `identity:get_project(project_id=a0ff5ebac97241d1bdc21088054ebf01)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:09.287675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f550b-775f-4a83-8c88-8071e397f143 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:09.289803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 592/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:49:09 2022] GET /identity/v3/projects/a0ff5ebac97241d1bdc21088054ebf01 => generated 361 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:49:09.297375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:09.419816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea523bab-318c-41eb-8e0e-7e6cce4ea69f None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:09.457500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba0438-f72e-4383-a459-23c35267eb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:09.458176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba0438-f72e-4383-a459-23c35267eb11 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:09.458456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba0438-f72e-4383-a459-23c35267eb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:09.458724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba0438-f72e-4383-a459-23c35267eb11 None admin] PATH_INFO: `/v3/projects/a0ff5ebac97241d1bdc21088054ebf01/users/97261be7502040a6843caa0dbb6d051f/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:09.460731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba0438-f72e-4383-a459-23c35267eb11 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0ff5ebac97241d1bdc21088054ebf01, user_id=97261be7502040a6843caa0dbb6d051f, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:09.462391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba0438-f72e-4383-a459-23c35267eb11 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:09.479896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 600/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:49:09 2022] PUT /identity/v3/projects/a0ff5ebac97241d1bdc21088054ebf01/users/97261be7502040a6843caa0dbb6d051f/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:49:11.492721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358d49-0f57-45bb-9c8b-3f5eb274cea5 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:11.493251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358d49-0f57-45bb-9c8b-3f5eb274cea5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:11.493603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5358d49-0f57-45bb-9c8b-3f5eb274cea5 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:11.495870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 593/1193] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:49:11.504398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:11.505191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:11.505191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:11.511498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:11.537872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:49:11.539673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:11.646650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 601/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:49:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:49:11.928340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5358d49-0f57-45bb-9c8b-3f5eb274cea5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:11.953971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:12.050427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5358d49-0f57-45bb-9c8b-3f5eb274cea5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:12.098766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:12.099807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:12.100269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:12.100551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:12.113002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:49:12.117676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:49:12.119455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:49:12.121434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 594/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:49:12.128340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:12.257065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122b218-4454-420f-b6d0-c093b195f309 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:12.294477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:12.300585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:12.301281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:12.301557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:12.301827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:12.302594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:49:12.302916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:12.304362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:12.314611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 602/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:49:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:49:12.320709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:12.409333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:12.442984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69c67f-6933-4467-8c6f-9f010f37f3e6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:12.485044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:12.485622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:12.485900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:12.486171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] PATH_INFO: `/v3/users/97261be7502040a6843caa0dbb6d051f` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:12.488680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=97261be7502040a6843caa0dbb6d051f)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:12.489018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:12.493266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 595/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Aug 24 09:49:12 2022] GET /identity/v3/users/97261be7502040a6843caa0dbb6d051f => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:12.501276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:12.624449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059140-20c1-4d39-ba10-f95cf457fc4d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:12.662797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:12.663594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:12.663877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:12.664289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:12.745180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:12.755633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:12.757109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:12.867427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 603/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:49:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:49:12.874010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:13.006296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394215c-c3c1-4b66-a685-c274a5e04fa2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:13.050317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7564f-a84a-486c-9d70-d341149a71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:13.050953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7564f-a84a-486c-9d70-d341149a71b6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:13.051458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7564f-a84a-486c-9d70-d341149a71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:13.051770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7564f-a84a-486c-9d70-d341149a71b6 None admin] PATH_INFO: `/v3/projects/a0ff5ebac97241d1bdc21088054ebf01` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:13.053127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7564f-a84a-486c-9d70-d341149a71b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a0ff5ebac97241d1bdc21088054ebf01)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:13.054559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7564f-a84a-486c-9d70-d341149a71b6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:13.056387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 596/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Aug 24 09:49:12 2022] GET /identity/v3/projects/a0ff5ebac97241d1bdc21088054ebf01 => generated 361 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:13.062809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:13.167282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:13.180789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4c24-5b48-4ca5-8362-ceb2f04f7a63 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:13.219377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:13.219995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:13.220271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:13.220537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:13.221273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a0ff5ebac97241d1bdc21088054ebf01, user.id=97261be7502040a6843caa0dbb6d051f) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:49:13.221653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:13.223170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09516659-4a50-40e0-a4de-8e6a5254baae None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:13.230820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 604/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:49:13 2022] GET /identity/v3/role_assignments?user.id=97261be7502040a6843caa0dbb6d051f&scope.project.id=a0ff5ebac97241d1bdc21088054ebf01&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:49:23.045366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=93 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:23.226892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=21 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:10.645160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf2c3-658b-4cfd-8d62-f08a246706a0 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:10.645160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf2c3-658b-4cfd-8d62-f08a246706a0 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:10.645160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf2c3-658b-4cfd-8d62-f08a246706a0 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:10.645160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 597/1201] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:10.653430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:10.653970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:10.653970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:10.681695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:10.682938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:10.791620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 605/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:11.141099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf2c3-658b-4cfd-8d62-f08a246706a0 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:11.303544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf2c3-658b-4cfd-8d62-f08a246706a0 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:11.373357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:11.374029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:11.374326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:11.374571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:11.392919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:11.394301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:11.416867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:11.418993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:11.420917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:11.420917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:11.420917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:11.425008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 598/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:11.426434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:11.565711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283ad0c-f66c-4487-823b-7d398d7da77b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:11.600974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:11.611095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951656b-7edb-424d-850e-96def699d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:11.611604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951656b-7edb-424d-850e-96def699d199 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:11.611925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951656b-7edb-424d-850e-96def699d199 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:11.612210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951656b-7edb-424d-850e-96def699d199 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:11.616174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951656b-7edb-424d-850e-96def699d199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:11.616174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951656b-7edb-424d-850e-96def699d199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:11.616174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951656b-7edb-424d-850e-96def699d199 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:11.629647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 606/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:11.640817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:11.724159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:11.803879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f486-c2ad-48c1-8c76-40d8f6a7e358 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:11.864502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79357-db5d-41db-9c0b-f7d66a241565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:11.864502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79357-db5d-41db-9c0b-f7d66a241565 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:11.864502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79357-db5d-41db-9c0b-f7d66a241565 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:11.864502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79357-db5d-41db-9c0b-f7d66a241565 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:11.864966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc79357-db5d-41db-9c0b-f7d66a241565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:11.866867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc79357-db5d-41db-9c0b-f7d66a241565 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:11.900310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 599/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Aug 24 09:50:11 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:50:14.247636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb632e-5d39-460e-a43a-cc2fd0296012 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:14.251817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb632e-5d39-460e-a43a-cc2fd0296012 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:14.251817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb632e-5d39-460e-a43a-cc2fd0296012 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:14.251817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 607/1206] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:50:14.255895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:14.256672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:14.257816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:14.291527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:14.293544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:14.441333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 600/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:14.747644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb632e-5d39-460e-a43a-cc2fd0296012 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:14.907348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb632e-5d39-460e-a43a-cc2fd0296012 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:14.958530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:14.959437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:14.959776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:14.960147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:14.980293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:50:14.995297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:14.996860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:14.998116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 608/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:15.003002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:15.060869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:15.159806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964adbef-5f1d-42cf-bb5a-632f2260b705 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:15.236156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:15.237088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:15.237568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:15.237848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:15.238538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:15.238848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:15.240280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:15.255499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 601/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:15.264724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:15.355142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:15.411710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026db81-fa62-4ce9-80a8-ab2621cb9e4e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:15.462526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:15.463638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:15.464237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:15.465030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:15.491766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:15.494115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:15.513623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:15.514882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:15.516219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:15.516219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:15.516219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:15.516219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 609/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:15.521091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:15.667316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:15.670919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efaf6-8420-406a-96fb-903f7b2f6e9e None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:15.719280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:15.720460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:15.721045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:15.721599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:15.722829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:15.723526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:15.725979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:15.747841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 602/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:15.754859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:15.959636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a167d7-7ba6-4743-b8cf-3f649e808253 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:15.962994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:16.026153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:16.027421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:16.027925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:16.028440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:16.044089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:16.046921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:50:16.070262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:16.071504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:16.077646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 610/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:16.079986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:16.256661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12dcbb-9e8b-4949-90b0-a7efa60a58db None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:16.305479 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:16.306114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:16.306515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:16.307127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:16.308279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:16.308688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:16.311182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:16.339757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 603/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 09:50:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:16.348543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:16.507526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb7682-e623-42aa-9932-292633ffdce4 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:16.546375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:16.547012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:16.547343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:16.547679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:16.587043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:16.634910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:16.636779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:16.784697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 611/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:50:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:50:16.793474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:16.819021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:16.923348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588cbbb-4266-4ba5-83a8-73358ca2c263 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:16.973540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:16.975421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:16.975934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:16.976439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:16.997101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:16.999948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:17.024959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:17.026788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:17.028019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:17.028019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:17.028019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:17.028019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 604/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:17.038634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:17.140333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:17.215468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f6228-b432-47d5-b6c5-9c8f4b4c11ef None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:17.290223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:17.290750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:17.291017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:17.291352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:17.292009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:17.292449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:17.294062 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:17.310517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 612/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:17.317754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:17.405964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:17.446666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf08ae-e9b0-4aaa-a8f3-3182e9bdc873 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:17.497120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:17.497778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:17.498059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:17.498370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:17.506761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:17.508272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:50:17.520488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:17.522937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:17.524997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 605/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:17.527735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:17.655138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16d86-7163-4708-8bb8-0bfbcad3846d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:17.690976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:17.704983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:17.705646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:17.706052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:17.706397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:17.707283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:17.707592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:17.709346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace69cf-d874-4e17-b496-27ce78c689bf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:17.725304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 613/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:17.733170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:17.874343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050c57d-0bfc-4eed-9237-57242c06a25c None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:17.912939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:17.921090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:17.921734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:17.922097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:17.922396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:17.923184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=087bb494630b463b841d23a1eaaed9d2) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:17.923482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:17.924985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc67af0-6f16-44c0-95fc-8e700dca6984 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:17.931337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 606/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:50:17 2022] GET /identity/v3/role_assignments?user.id=087bb494630b463b841d23a1eaaed9d2&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:19.858050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdac14-d9a6-4881-ac2a-a278c735430e None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:19.858885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdac14-d9a6-4881-ac2a-a278c735430e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:19.858885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdac14-d9a6-4881-ac2a-a278c735430e None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:19.860006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 614/1220] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:19.865788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:19.866355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:19.866355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:19.888748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:19.890279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:19.982520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 607/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:20.266516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdac14-d9a6-4881-ac2a-a278c735430e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:20.393202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdac14-d9a6-4881-ac2a-a278c735430e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:20.439088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:20.439746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:20.440031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:20.440302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:20.453677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:50:20.460261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:20.461467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:50:20.462461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:20.467429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 615/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:20.468523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:20.597961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b564-7dbc-4e88-9b0e-9d5dabcd5ab2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:20.629994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:20.646582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:20.647323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:20.647729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:20.648072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:20.648767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:20.649214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:20.650931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:20.663214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 608/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:20.669760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:20.728028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:20.793823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05e7e-327c-478e-8e9c-3698bcad976e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:20.845036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:20.845686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:20.845960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:20.846229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:20.860198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:20.861674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:20.883178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:20.885158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:20.886056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:20.886056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:20.886056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:20.886056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 616/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:20.893438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:21.029893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050ed45-8f83-4447-bb20-d9d5f7a3a7c8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:21.076591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:21.077319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:21.077665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:21.078140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:21.078869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:21.079234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:21.081136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:21.095671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 609/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:21.103705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:21.233307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:21.241668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831505e-f952-48b8-81e6-534e3eab5088 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:21.281594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:21.282344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:21.282643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:21.282924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:21.293124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:21.294638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:50:21.307191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:21.308699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:21.310444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:21.314412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:21.314844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 617/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:21.380822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:21.475616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb4b91-e3bc-4201-a849-296dc28c61e8 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:21.522116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:21.522734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:21.523014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:21.523313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:21.524111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:21.524408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:21.525883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:21.554812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 610/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 09:50:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:21.560605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:21.699270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942bdef-1dea-4d00-9a4d-d9cdcf72ffe0 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:21.744139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:21.744795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:21.745084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:21.745356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:21.757927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:21.759455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:21.776093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:21.777829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:21.779410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:21.779410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:21.779410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:21.779410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 618/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:21.785259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:21.911866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd892a-3a83-4870-88e7-06f28d8be1d9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:21.914306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:21.955448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:21.956806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:21.956806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:21.956806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:21.957355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:21.958244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:21.959445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:21.973359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 611/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:21.980710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:21.994176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:22.124314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a449b9-3d1e-40c1-82a3-f2236dfa71f2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:22.165629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:22.166482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:22.166815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:22.167170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:22.176514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:22.178037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:50:22.191728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:22.192925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:22.200168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 619/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:22.202806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:22.340023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33758-e09a-4cc0-8f74-16a311ff4524 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:22.382763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:22.383297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:22.383539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:22.383851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:22.384586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:22.384856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:22.386790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced191-840b-4fc9-b0ed-9b84d6b8fce8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:22.401268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 612/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:22.408430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:22.499461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:22.543887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744fd12-1156-4ec9-899f-0ced36528e39 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:22.590320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e19a6-7d03-4dd1-b1ae-0e3423055aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:22.591076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e19a6-7d03-4dd1-b1ae-0e3423055aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:22.591375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e19a6-7d03-4dd1-b1ae-0e3423055aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:22.591644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e19a6-7d03-4dd1-b1ae-0e3423055aa8 None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/087bb494630b463b841d23a1eaaed9d2/roles/2e215dbe61d44256bedb8a0148b2748e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:22.610222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e19a6-7d03-4dd1-b1ae-0e3423055aa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=087bb494630b463b841d23a1eaaed9d2, role_id=2e215dbe61d44256bedb8a0148b2748e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:22.611824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e19a6-7d03-4dd1-b1ae-0e3423055aa8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:22.629525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 620/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:50:22 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/087bb494630b463b841d23a1eaaed9d2/roles/2e215dbe61d44256bedb8a0148b2748e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:50:24.854118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e284-5791-40ac-b4ff-df4626da5257 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:24.854774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e284-5791-40ac-b4ff-df4626da5257 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:24.854774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e284-5791-40ac-b4ff-df4626da5257 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:24.856310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 613/1233] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:24.864375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:24.864955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:24.864955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:24.885886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:24.887125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:24.965350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 621/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:25.246236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e284-5791-40ac-b4ff-df4626da5257 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:25.279067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:25.370391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e284-5791-40ac-b4ff-df4626da5257 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:25.409857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:25.410634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:25.410916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:25.411241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:25.422419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:50:25.428620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:25.429908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:25.431108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 614/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Aug 24 09:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:25.436151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:25.494896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:25.553098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da27d7-0f68-4a16-8b95-81618c4c9f80 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:25.594489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:25.595479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:25.596055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:25.596438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:25.597245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:25.597651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:25.599061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:25.607858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 622/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Aug 24 09:50:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:25.614562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:25.707671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:25.729399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037b41-c1fc-4d13-9b11-7b6776af69a5 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:25.773225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:25.773768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:25.774033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:25.774313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:25.786411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:25.787953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:25.802552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:25.803771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:25.804957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:25.804957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:25.804957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:25.804957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 615/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:25.810525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:25.939745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099fac-ca7a-4ac0-9177-068a97c813f9 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:25.951346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:25.985225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:25.986395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:25.986740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:25.986953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:25.987738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:25.988042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:25.991163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:26.007839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 623/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:26.013946 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:26.128008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25d23f-9fda-42a5-a4f4-015d08756c53 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:26.171273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:26.171935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:26.172230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:26.172476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:26.176293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:26.183263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:26.185480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:50:26.201008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:26.202078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:26.203068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 616/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:26.209323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:26.347192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a991a8-7191-4a94-a760-ad8593ec5e11 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:26.396660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:26.397337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:26.397618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:26.397923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:26.398743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:26.399040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:26.400504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:26.425091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 624/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 09:50:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:26.431898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:26.565977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5489-6db4-4805-882f-570234abe044 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:26.610902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:26.611548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:26.611831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:26.612106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:26.686390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:26.701819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:26.703608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:26.839173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 617/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:50:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:50:26.845986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:26.883260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:26.980177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604e95-dc5f-4b04-8c95-146b957f529d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:27.028652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:27.029405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:27.029769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:27.030066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:27.042413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:27.044029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:27.065572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:27.066822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:27.068519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:27.068519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:27.068519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:27.068519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 625/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:27.074404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:27.191949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:27.200572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9744c-ae42-4b29-9018-ef5daf2b4815 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:27.249153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:27.249924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:27.250301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:27.250808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:27.252567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:27.252567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:27.253570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:27.268426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 618/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:27.274656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:27.359534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:27.383775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b520df-5e56-480d-8739-7fd78766a992 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:27.420130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:27.420759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:27.421185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:27.421477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:27.429643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:27.431206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:50:27.444134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:27.445260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:27.446331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 626/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:27.451768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:27.573419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4969c6-5f10-48d3-ad53-e88baa9025c6 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:27.611653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:27.612258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:27.612535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:27.612805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:27.613501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:27.613802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:27.615254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73120-67a2-4690-9c3e-3c7c03727247 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:27.630375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 619/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:27.637116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:27.751741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483eb1-3ff7-4232-a3c1-bfb9569d1fc6 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:27.792181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:27.792958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:27.793239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:27.793510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:27.794386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] RBAC: Adding query filter params (role.id=2e215dbe61d44256bedb8a0148b2748e, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=087bb494630b463b841d23a1eaaed9d2) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:27.794770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:27.796553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174c39-84ee-4e22-9162-7e548be7fdb3 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:27.804278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 627/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:50:27 2022] GET /identity/v3/role_assignments?user.id=087bb494630b463b841d23a1eaaed9d2&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=2e215dbe61d44256bedb8a0148b2748e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:29.981921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4d2a-98cb-4704-82f2-2067493db226 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:29.982503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4d2a-98cb-4704-82f2-2067493db226 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:29.982503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4d2a-98cb-4704-82f2-2067493db226 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:29.984725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 620/1247] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:29.990776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:29.991303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:29.991538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:29.998736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:30.014472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:30.015824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:30.095981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 628/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:30.388889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d4d2a-98cb-4704-82f2-2067493db226 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:30.409223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:30.501330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d4d2a-98cb-4704-82f2-2067493db226 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:30.541595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:30.542310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:30.542618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:30.542861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:30.553399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:50:30.558006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:30.558973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:30.559872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 621/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:30.566119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:30.672828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b66d-ee08-430f-a081-319b4b1b8e85 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:30.704069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:30.710533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:30.711346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:30.711815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:30.712186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:30.713088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:30.713511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:30.715388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:30.727116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 629/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:30.735742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:30.827605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:30.854720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd28af-3d51-4eaa-b4ca-415ae768eb55 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:30.895800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:30.896575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:30.896879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:30.897149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:30.909037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:30.910368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:30.928230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:30.930274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:30.932482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:30.932482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:30.932482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:30.932482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 622/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:30.937548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:31.060911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d264f5-bbeb-4e28-96d4-f8ea5afc6c1d None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:31.102914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:31.103588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:31.104004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:31.104285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:31.104971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:31.105405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:31.106829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:31.121255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 630/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:31.128085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:31.247322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bed6af-0d03-4c24-ad37-063cd3475a0d None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:31.277048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:31.286355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:31.287163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:31.287411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:31.287716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:31.298567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:31.300482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:50:31.312746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:31.313817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:31.314757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 623/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:31.321096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:31.388094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:31.442168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666df0-66a2-4d68-8218-7ede15a0d338 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:31.487680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:31.488268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:31.488550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:31.488823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:31.489568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:31.489871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:31.491402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:31.513977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 631/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 09:50:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:31.521511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:31.637308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c68da-880a-4d68-b2ad-dc98ea47e089 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:31.679689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:31.680497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:31.680774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:31.681041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:31.747971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:31.762480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:31.764351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:31.886304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 624/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:50:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:50:31.891071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.024120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdb984-13f8-42c4-aaa7-da08ffa825ef None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.044877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:32.071526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.072198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.072434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.072737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.085942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.087503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:32.109289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:32.110492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:32.111435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:32.111435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:32.111435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:32.111435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 632/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:32.117032 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.227476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:32.247819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed48-18f9-4602-99c4-c4daf5288303 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.291714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.292370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.292682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.292985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.293702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:32.294072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.297222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.313027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 625/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:32.323394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.441059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0e52a-1d35-482c-a970-20a637a4b62e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.481244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.481875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.482152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.482430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.491342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.492940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:50:32.504951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:32.506458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:32.507668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 633/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:32.512504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.626127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa033-5d50-4220-9b02-85afbf5a2896 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.668563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.669187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.669611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.669891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.670651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:32.671078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.672712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030349a5-5587-4caf-8969-d386b2cc44ff None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.687862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 626/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:32.695011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.726589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:32.813714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57c28-47a2-4cbc-bf51-549a39cc5930 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.850940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.851666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.851936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.852231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.853097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=087bb494630b463b841d23a1eaaed9d2) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:32.853518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.854982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071737f4-6bbb-4ab4-bb78-0af28ce817e1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.861387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 634/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:50:32 2022] GET /identity/v3/role_assignments?user.id=087bb494630b463b841d23a1eaaed9d2&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:34.814948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3552-66d1-48ed-9b4f-f309f0395dd8 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:34.815558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3552-66d1-48ed-9b4f-f309f0395dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:34.815558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3552-66d1-48ed-9b4f-f309f0395dd8 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:34.816882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 627/1261] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:34.822154 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:34.822588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:34.822677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:34.842435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:34.843416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:34.914063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 635/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:35.183158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3552-66d1-48ed-9b4f-f309f0395dd8 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:35.197511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:35.331546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3552-66d1-48ed-9b4f-f309f0395dd8 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:35.367869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:35.368508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:35.368790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:35.369065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:35.380840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:50:35.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:35.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:35.388996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 628/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:50:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:35.393271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:35.412215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:35.500106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352296be-9954-41e7-89db-22b0d23acdd9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:35.536590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:35.537207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:35.537487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:35.537753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:35.538425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:35.538725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:35.540134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:35.549626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 636/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:50:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:35.555759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:35.629532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:35.664751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a091-6971-457f-8e68-b57391b679df None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:35.705518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:35.706153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:35.706429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:35.706703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:35.717891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:35.719363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:35.733727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:35.735453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:35.736484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:35.736484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:35.736484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:35.736484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 629/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:35.741143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:35.832367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:35.858367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5276e-4f62-44ad-82c1-05bfa4afebb0 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:35.895858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:35.896468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:35.896750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:35.897022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:35.897676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:35.897985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:35.899383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:35.912860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 637/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:35.918766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:36.031066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9ef17-eff1-4b46-b22e-3501494b1d48 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:36.054057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:36.071618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:36.072271 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:36.072548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:36.072817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:36.086272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:36.088915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:50:36.102122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:36.103327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:36.104554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 630/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:36.109533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:36.242522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f3e5-2c0b-4ce9-8f73-256fc77b6e48 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:36.281727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:36.282346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:36.282624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:36.283005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:36.283780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:36.284079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:36.285563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:36.296522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:36.305412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 638/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 09:50:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:50:36.313913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:36.474068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528414f0-3bac-45dc-9a94-2a9b61d87bb9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:36.514211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:36.514844 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:36.515146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:36.515416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:36.527174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:36.528685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:36.554409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:36.555721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:36.557012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:36.557012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:36.557012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:36.557012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 631/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:36.561789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:36.676694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c7e50-58ec-44b9-bca4-5117cffd0222 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:36.728303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:36.728821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:36.729099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:36.729372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:36.730010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:36.730309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:36.731936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:36.744058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 639/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:36.750292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:36.787891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:36.865929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65502c8-9e5c-4e93-b7e8-05457282a5d3 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:36.900952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:36.901642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:36.901889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:36.902150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:36.909351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:36.910840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:50:36.923427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:36.925823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:36.926762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 632/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:36.931083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:37.005277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:37.056484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2094807-e9c3-4a87-9e05-cf8cfe8e5a7e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:37.105138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:37.105756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:37.106035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:37.106413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:37.107803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:37.108110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:37.109554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90b39-2907-4dce-b61d-e936b223a6a1 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:37.123075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 640/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:37.129182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:37.255812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:37.265017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ebaea-c661-458f-b8c8-506d1a9869f2 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:37.299635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a6d14-3133-4618-8bf3-f55eb1bd7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:37.300304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a6d14-3133-4618-8bf3-f55eb1bd7e4c None admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:37.300580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a6d14-3133-4618-8bf3-f55eb1bd7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:37.300843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a6d14-3133-4618-8bf3-f55eb1bd7e4c None admin] PATH_INFO: `/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/087bb494630b463b841d23a1eaaed9d2/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:37.302926 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a6d14-3133-4618-8bf3-f55eb1bd7e4c None admin] RBAC: Authorizing `identity:create_grant(project_id=a65be9cc173f4e8bb9e353806222cb4e, user_id=087bb494630b463b841d23a1eaaed9d2, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:37.304407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a6d14-3133-4618-8bf3-f55eb1bd7e4c None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:37.319253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 633/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Aug 24 09:50:37 2022] PUT /identity/v3/projects/a65be9cc173f4e8bb9e353806222cb4e/users/087bb494630b463b841d23a1eaaed9d2/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:50:39.274870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11429eb1-a60d-4afa-8216-b705735106ca None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:39.275569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11429eb1-a60d-4afa-8216-b705735106ca None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:39.275667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11429eb1-a60d-4afa-8216-b705735106ca None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:39.277084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 641/1274] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:50:39.284631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:39.285260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:39.285260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:39.305851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:39.307068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:39.380879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 634/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:50:39.650374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11429eb1-a60d-4afa-8216-b705735106ca None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:39.767233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11429eb1-a60d-4afa-8216-b705735106ca None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:39.791397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:39.813519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:39.814144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:39.814418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:39.814686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:39.825280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:50:39.830167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:39.831328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:39.832283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 642/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Aug 24 09:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:50:39.837514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:39.921604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:39.940591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64738a2-d46b-44bb-91f6-be59b524719a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:39.975937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:39.976542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:39.976814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:39.977081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:39.977733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:39.978030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:39.979437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:39.991794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 635/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Aug 24 09:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:39.998018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:40.113119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba99bb-f5ae-4ca0-b79c-56e6cf72101e None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:40.161365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:40.162150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:40.162626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:40.162910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:40.176048 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:40.177487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:40.205721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:40.207659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:40.209308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:40.209308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:40.209308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:40.209308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 643/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:40.217516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:40.359975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cf848-12d4-435b-bdde-02785e71b5e9 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:40.400111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:40.400735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:40.401016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:40.401289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:40.402222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:40.402588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:40.404213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:40.417152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 636/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:40.424303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:40.459955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:40.538317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed928c-e5e8-48d0-8425-7f34080f7ece None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:40.572771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:40.573398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:40.573762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:40.573987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:40.581804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:40.583283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:50:40.595190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:40.596391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:40.597640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 644/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:40.602452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:40.607308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:40.725093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10530aeb-d62f-44b6-9745-3e5f0a9b9a50 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:40.762259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:40.762893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:40.763196 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:40.763464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:40.764199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:40.764497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:40.765924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:40.787125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 637/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Aug 24 09:50:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:40.793469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:40.906682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:40.923430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097b7e-e0e7-498b-9763-634d628f1311 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:40.975796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:40.976310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:40.976583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:40.976849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:41.050507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:41.052046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:41.146797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:41.162335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 645/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Aug 24 09:50:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:50:41.172098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:41.251188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:41.299216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff239bec-7f51-46da-8838-f69e427b2aee None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:41.338688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:41.339445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:41.339875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:41.340360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:41.353456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:41.354987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:50:41.377204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:41.379033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:50:41.380185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:50:41.380185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:50:41.380185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:41.380185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 638/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:41.386151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:41.496413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db447786-26d2-4eee-83dd-feb414b0fdde None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:41.532798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:41.533316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:41.533598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:41.533893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:41.534545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:41.534826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:41.536250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:41.550400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 646/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Aug 24 09:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:41.558051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:41.664536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1423-8e0f-408f-afa4-54a8c90d4991 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:41.678988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:41.700915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:41.701841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:41.702143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:41.702416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:41.709199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:41.710647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:50:41.721753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:41.722834 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: ERROR keystone.server.flask.application Aug 24 09:50:41.723782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 639/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Aug 24 09:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:41.729357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:41.781944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:41.835064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bddfd2-0774-4bef-a07b-65d6668cacf2 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:41.872803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:41.873419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:41.873695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:41.873963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:41.874661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:41.874963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:41.876434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9f3b5-707e-4853-a51a-317366c89fbf None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:41.889484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 647/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Aug 24 09:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:41.895892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:42.000060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead66dc-2a3c-4fe1-8d8f-369e92612887 None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:42.033524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:42.034103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:42.034409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:42.034677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:42.035445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] RBAC: Adding query filter params (role.id=f94a13e285524b5d988cbb296e8a4309, scope.project.id=a65be9cc173f4e8bb9e353806222cb4e, user.id=087bb494630b463b841d23a1eaaed9d2) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:42.035752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:42.037184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e48abd-df50-45f2-83e7-4249a7af0520 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:42.043910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 640/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Aug 24 09:50:41 2022] GET /identity/v3/role_assignments?user.id=087bb494630b463b841d23a1eaaed9d2&scope.project.id=a65be9cc173f4e8bb9e353806222cb4e&role.id=f94a13e285524b5d988cbb296e8a4309 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:43.968706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea027b-4c47-41d5-aaa4-e67693387d21 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:43.969270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea027b-4c47-41d5-aaa4-e67693387d21 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:43.969270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea027b-4c47-41d5-aaa4-e67693387d21 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:43.970598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 648/1288] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:43.976671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:43.977101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:43.977241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:44.001488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:44.002665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:44.036240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:44.078916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 641/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:44.357828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea027b-4c47-41d5-aaa4-e67693387d21 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:44.474790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea027b-4c47-41d5-aaa4-e67693387d21 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:44.486334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:44.520137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:44.520895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:44.521225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:44.521539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:44.522304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:44.524295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:44.533662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:44.534855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:44.535886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 649/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:50:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:44.541345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:44.656714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ab4dd-0a9c-4775-8a1c-145da04b8af1 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:44.698467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:44.699415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:44.699806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:44.700238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:44.701467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:44.701778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:44.703292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80562a14-53a5-4b91-8643-bede6ceece61 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:44.711178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 642/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 09:50:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:44.717903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:44.853816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d80c0-e9e1-4cc9-88cc-3c84188f1cd7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:44.900554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:44.901359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:44.901786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:44.902210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] PATH_INFO: `/v3/services` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:44.903278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:44.903813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:44.905481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230d4b8-3c57-48da-ab8c-3c3bba8b5ba8 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:44.911275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 650/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 09:50:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:46.802227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7074ae-fc08-49e4-8553-1cbb7d0723f4 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:46.802796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7074ae-fc08-49e4-8553-1cbb7d0723f4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:46.802796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7074ae-fc08-49e4-8553-1cbb7d0723f4 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:46.804179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 643/1293] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:46.809630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab36b9-dfd9-4ee1-961f-7fdb377f6e65 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:46.810066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab36b9-dfd9-4ee1-961f-7fdb377f6e65 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:46.810156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab36b9-dfd9-4ee1-961f-7fdb377f6e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:46.837473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-dfab36b9-dfd9-4ee1-961f-7fdb377f6e65 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:46.838809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dfab36b9-dfd9-4ee1-961f-7fdb377f6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:46.868721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:46.908701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 651/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:47.183755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7074ae-fc08-49e4-8553-1cbb7d0723f4 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:47.226843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:47.319536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7074ae-fc08-49e4-8553-1cbb7d0723f4 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:47.356400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916fbe-2656-43f4-93e0-05871f67c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:47.357079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916fbe-2656-43f4-93e0-05871f67c4c8 None admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:47.357358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916fbe-2656-43f4-93e0-05871f67c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:47.357631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916fbe-2656-43f4-93e0-05871f67c4c8 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:47.358275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916fbe-2656-43f4-93e0-05871f67c4c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:47.359683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916fbe-2656-43f4-93e0-05871f67c4c8 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:47.381910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 644/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Aug 24 09:50:47 2022] POST /identity/v3/services => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:50:49.310709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8c3f-a1ef-4691-9000-940c7adee4da None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:49.311337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8c3f-a1ef-4691-9000-940c7adee4da None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:49.311337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8c3f-a1ef-4691-9000-940c7adee4da None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:49.312653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 652/1296] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:49.318534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:49.319098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:49.319098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:49.343178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:49.344422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:49.434688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 645/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:49.700066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb8c3f-a1ef-4691-9000-940c7adee4da None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:49.821676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb8c3f-a1ef-4691-9000-940c7adee4da None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:49.859982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:49.860614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:49.860897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:49.861166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:49.861761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:49.863305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:49.872407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:49.873633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:49.874718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 653/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:50:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:49.879876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:49.899229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:49.984001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd455b-c38c-4b9f-90e8-799442810f74 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:50.019826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:50.020432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:50.020705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:50.020935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:50.021683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:50.021865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:50.023274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:50.029010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 646/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 09:50:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:50.035397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:50.071027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:50.155502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f733b-f1a4-41a6-8a72-cc01f53141bb None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:50.195429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:50.196735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:50.197227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:50.197501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:50.198332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] RBAC: Adding query filter params (interface=public, service_id=b1145fe17e184e84aec1dc494b90130f, region_id=RegionOne) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:50.198718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:50.200625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71cd7-9485-4cb5-9cc4-7fa2f0ff222a None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:50.207205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 654/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Aug 24 09:50:50 2022] GET /identity/v3/endpoints?service_id=b1145fe17e184e84aec1dc494b90130f&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:50.213865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:50.317066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:50.338129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11001-2819-426d-87a2-465dfb60472f None admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:50.378167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51763caa-7ef9-4257-a906-6d1894ff5986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:50.378778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763caa-7ef9-4257-a906-6d1894ff5986 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:50.379091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763caa-7ef9-4257-a906-6d1894ff5986 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:50.379356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763caa-7ef9-4257-a906-6d1894ff5986 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:50.379969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51763caa-7ef9-4257-a906-6d1894ff5986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:50.381364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51763caa-7ef9-4257-a906-6d1894ff5986 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:50.388846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 647/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Aug 24 09:50:50 2022] GET /identity/v3/services => generated 2191 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:50:52.332259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff8872-c671-4283-81b8-902e9f9b1b71 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:52.332980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff8872-c671-4283-81b8-902e9f9b1b71 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:52.332980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff8872-c671-4283-81b8-902e9f9b1b71 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:52.334241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 655/1302] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:50:52.340586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:52.341053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:52.341244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:52.362090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:52.363348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:52.437092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 648/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:50:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:50:52.719177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff8872-c671-4283-81b8-902e9f9b1b71 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:52.821003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:52.829225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff8872-c671-4283-81b8-902e9f9b1b71 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:52.864155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:52.864783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:52.865061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:52.865333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:52.865912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:52.867379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:50:52.876301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:50:52.877332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application with Lock( Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: ERROR keystone.server.flask.application Aug 24 09:50:52.878299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 656/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Aug 24 09:50:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:50:52.884155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:52.968311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:52.992754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d85f5-6208-4d58-a3c4-3bff1f6f8711 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:53.028979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:53.029593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:53.029870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:53.030144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] PATH_INFO: `/v3/services` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:53.030773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:50:53.031097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:53.032471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62469-bfe2-4d3d-8bde-cde81d645bb6 None admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:53.038086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 649/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Aug 24 09:50:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:50:53.044220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:53.153926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced5b3-acca-4171-8be0-bea725a569a7 None admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:53.193962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30880570-f558-4d6b-bf75-bdc4836b2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:53.194603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30880570-f558-4d6b-bf75-bdc4836b2405 None admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:53.194884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30880570-f558-4d6b-bf75-bdc4836b2405 None admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:53.195185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30880570-f558-4d6b-bf75-bdc4836b2405 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:53.195857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30880570-f558-4d6b-bf75-bdc4836b2405 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:53.197405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30880570-f558-4d6b-bf75-bdc4836b2405 None admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:53.220362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 657/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:50:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:03.035385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=30 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:03.216160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:00.679450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6a9ac-440c-46db-ad2c-c7cd2f32daf5 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.681010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6a9ac-440c-46db-ad2c-c7cd2f32daf5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.681526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6a9ac-440c-46db-ad2c-c7cd2f32daf5 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.692297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf373-30f9-4975-a64b-67dcb62de517 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.693737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf373-30f9-4975-a64b-67dcb62de517 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.694257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf373-30f9-4975-a64b-67dcb62de517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.697675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 650/1307] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:00 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:00.814482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-716bf373-30f9-4975-a64b-67dcb62de517 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:00.816250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-716bf373-30f9-4975-a64b-67dcb62de517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:00.960208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 658/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:01.318846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ef8d4-8968-441e-8c26-de3b2930b4ed None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.319225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ef8d4-8968-441e-8c26-de3b2930b4ed None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.319485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ef8d4-8968-441e-8c26-de3b2930b4ed None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.321117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 651/1309] 10.222.0.65 () {54 vars in 965 bytes} [Wed Aug 24 09:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:01.328169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440eba4-9ebe-4a45-a7c5-bd09e9036376 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.329100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440eba4-9ebe-4a45-a7c5-bd09e9036376 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.329616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440eba4-9ebe-4a45-a7c5-bd09e9036376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.435068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8440eba4-9ebe-4a45-a7c5-bd09e9036376 None None] MFA Rules not processed for user `e8980803eace443d849c22a6e0781894`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:01.436329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8440eba4-9ebe-4a45-a7c5-bd09e9036376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:01.463099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:01.526397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 659/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Aug 24 09:52:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:52:01.535870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ef8d4-8968-441e-8c26-de3b2930b4ed None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:01.537643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0a3ef8d4-8968-441e-8c26-de3b2930b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:01.662873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ef8d4-8968-441e-8c26-de3b2930b4ed None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:01.749008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:01.749652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:01.749886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:01.750106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:01.751787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:01.809289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:01.871089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:01.872595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359251-aa53-4a01-bb83-01c089ca71fd service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:01.893145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 652/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:52:04.174632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293640-abb1-4554-a7fc-5f1ee33b2f6d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.175225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293640-abb1-4554-a7fc-5f1ee33b2f6d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.175225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293640-abb1-4554-a7fc-5f1ee33b2f6d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.176544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 660/1312] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:04.182626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae5a95-4461-47f8-8b62-b916f86700bd None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.183126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae5a95-4461-47f8-8b62-b916f86700bd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.183518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae5a95-4461-47f8-8b62-b916f86700bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.274556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4dae5a95-4461-47f8-8b62-b916f86700bd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:04.275864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4dae5a95-4461-47f8-8b62-b916f86700bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:04.384708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 653/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:04.678435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293640-abb1-4554-a7fc-5f1ee33b2f6d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:04.680341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3b293640-abb1-4554-a7fc-5f1ee33b2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:04.801999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293640-abb1-4554-a7fc-5f1ee33b2f6d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:04.917755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:04.920981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:04.921732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:04.922512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:04.923226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:04.925809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:05.062914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:05.064881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856035f5-27d5-43aa-bf6d-6f8e3404b4c8 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:05.088199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 661/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:07.366259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e32d9e-8e5d-4324-8235-ff017a34890e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.366826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e32d9e-8e5d-4324-8235-ff017a34890e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.366826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e32d9e-8e5d-4324-8235-ff017a34890e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.368194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 654/1315] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:52:07.373476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5767-0bce-4c3c-b6f0-7e1ab2557890 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.373959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5767-0bce-4c3c-b6f0-7e1ab2557890 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.374083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5767-0bce-4c3c-b6f0-7e1ab2557890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.448820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b32f5767-0bce-4c3c-b6f0-7e1ab2557890 None None] MFA Rules not processed for user `4e466019f8ec487cb0208e3023b4adc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:07.450045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b32f5767-0bce-4c3c-b6f0-7e1ab2557890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:07.503097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.548277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 662/1316] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:07.850666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654d926-0456-4e67-8378-7244b2589c3b None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.850950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654d926-0456-4e67-8378-7244b2589c3b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.851260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654d926-0456-4e67-8378-7244b2589c3b None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.852645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 655/1317] 10.222.0.65 () {54 vars in 965 bytes} [Wed Aug 24 09:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:07.858718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff2dad-8d70-4dd4-b4b4-b0e1f4afa4ab None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.859011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff2dad-8d70-4dd4-b4b4-b0e1f4afa4ab None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.859307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff2dad-8d70-4dd4-b4b4-b0e1f4afa4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.945530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0aff2dad-8d70-4dd4-b4b4-b0e1f4afa4ab None None] MFA Rules not processed for user `e8980803eace443d849c22a6e0781894`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:07.946773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0aff2dad-8d70-4dd4-b4b4-b0e1f4afa4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.026177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 663/1318] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Aug 24 09:52:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:08.035521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654d926-0456-4e67-8378-7244b2589c3b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.037886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f654d926-0456-4e67-8378-7244b2589c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.051253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:08.155689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654d926-0456-4e67-8378-7244b2589c3b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:08.234005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:08.234646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.234916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.235287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.236877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.299608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:08.350178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:08.351652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd20c-29df-4e5f-bc91-11f4d9c94a6f service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:08.370765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 656/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:11.194770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba5394-0ae5-4a9b-94c1-a01110de11cf None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.195458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba5394-0ae5-4a9b-94c1-a01110de11cf None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.195544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba5394-0ae5-4a9b-94c1-a01110de11cf None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.197184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 664/1320] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:11.202463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b559f-5f74-41d3-affd-5d85f7f9956c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.202915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b559f-5f74-41d3-affd-5d85f7f9956c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.203010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b559f-5f74-41d3-affd-5d85f7f9956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.281870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-668b559f-5f74-41d3-affd-5d85f7f9956c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:11.283514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-668b559f-5f74-41d3-affd-5d85f7f9956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:11.398934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 657/1321] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:52:11.681306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba5394-0ae5-4a9b-94c1-a01110de11cf None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:11.683083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e9ba5394-0ae5-4a9b-94c1-a01110de11cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:11.741390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:11.797641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba5394-0ae5-4a9b-94c1-a01110de11cf None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:11.876825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:11.877439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:11.877711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:11.878011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:11.879610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:11.991856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:12.006755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:12.008287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f6e60-5d2a-43c1-8926-847efa146726 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:12.028045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 665/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:14.728256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf01e0-59a8-4331-b888-5024417757d1 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.730555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf01e0-59a8-4331-b888-5024417757d1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.730555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf01e0-59a8-4331-b888-5024417757d1 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.730555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 658/1323] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:14.737239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9829-48ce-4f71-bf5a-ebe363f25e91 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:14.737796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9829-48ce-4f71-bf5a-ebe363f25e91 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:14.737796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9829-48ce-4f71-bf5a-ebe363f25e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:14.845215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-cfef9829-48ce-4f71-bf5a-ebe363f25e91 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:14.847029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cfef9829-48ce-4f71-bf5a-ebe363f25e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:14.970125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 666/1324] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:15.293393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf01e0-59a8-4331-b888-5024417757d1 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:15.295017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-eebf01e0-59a8-4331-b888-5024417757d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:15.323356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.456073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf01e0-59a8-4331-b888-5024417757d1 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:15.585781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:15.588650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:15.588940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:15.589250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:15.592550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:15.688867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:15.736678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:15.738175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee379a1-3c82-448c-b773-485b57371d30 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:15.758754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 659/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:52:17.749123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06224b-1c8b-44e2-9ebe-3c2da7f513e3 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.749951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06224b-1c8b-44e2-9ebe-3c2da7f513e3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.749951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06224b-1c8b-44e2-9ebe-3c2da7f513e3 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.751215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 667/1326] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:17.757036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a7c8-edac-4b1f-9638-8f4decfc076b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:17.757463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a7c8-edac-4b1f-9638-8f4decfc076b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:17.757575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a7c8-edac-4b1f-9638-8f4decfc076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:17.829224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f698a7c8-edac-4b1f-9638-8f4decfc076b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:17.830445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f698a7c8-edac-4b1f-9638-8f4decfc076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:17.950948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 660/1327] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:18.241229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06224b-1c8b-44e2-9ebe-3c2da7f513e3 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:18.242750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1c06224b-1c8b-44e2-9ebe-3c2da7f513e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:18.322351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.373829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06224b-1c8b-44e2-9ebe-3c2da7f513e3 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:18.455921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:18.456532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:18.456806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:18.457087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:18.459187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:18.586684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.591007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:18.593831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229358e-ab4c-4e4a-965f-5dd6eb3b81f3 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:18.620800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 668/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:20.766150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac444b3b-c8c5-43dd-b88f-5bf43084c562 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:20.767009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac444b3b-c8c5-43dd-b88f-5bf43084c562 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:20.767243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac444b3b-c8c5-43dd-b88f-5bf43084c562 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:20.770436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 661/1329] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:20.779584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e53dd-3bae-44d3-bae0-c8cc18b6251d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:20.780276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e53dd-3bae-44d3-bae0-c8cc18b6251d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:20.780276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e53dd-3bae-44d3-bae0-c8cc18b6251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:20.855497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b88e53dd-3bae-44d3-bae0-c8cc18b6251d None None] MFA Rules not processed for user `4e466019f8ec487cb0208e3023b4adc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:20.856722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b88e53dd-3bae-44d3-bae0-c8cc18b6251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:20.989262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 669/1330] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:21.284428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac444b3b-c8c5-43dd-b88f-5bf43084c562 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:21.286296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ac444b3b-c8c5-43dd-b88f-5bf43084c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:21.327959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.416831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac444b3b-c8c5-43dd-b88f-5bf43084c562 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:21.504634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:21.505115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:21.505391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:21.505684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:21.507495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:21.597133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:21.643475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:21.645646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68981702-65aa-4150-9ace-dbd72bf504e3 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:21.668156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 662/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:23.946680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec1c3-b103-4f0b-ad4e-678b698f8441 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.947250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec1c3-b103-4f0b-ad4e-678b698f8441 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.947345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec1c3-b103-4f0b-ad4e-678b698f8441 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:23.948660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 670/1332] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:23.958034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d5ab-502e-40e8-8352-a934a09fac43 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:23.958482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d5ab-502e-40e8-8352-a934a09fac43 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:23.958880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d5ab-502e-40e8-8352-a934a09fac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:24.029865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9577d5ab-502e-40e8-8352-a934a09fac43 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:24.031081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9577d5ab-502e-40e8-8352-a934a09fac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:24.140788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 663/1333] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:24.432786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ec1c3-b103-4f0b-ad4e-678b698f8441 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:24.434314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a37ec1c3-b103-4f0b-ad4e-678b698f8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:24.514973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:24.557006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ec1c3-b103-4f0b-ad4e-678b698f8441 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:24.638616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:24.639268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:24.639539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:24.639801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:24.641685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:24.762761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:24.765306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403ef28-9821-43c7-9a4a-3fe5fd233ca0 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:24.777222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:24.786816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 671/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:26.765714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8fc9b-671f-4f4a-868e-d52d66707466 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.766782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8fc9b-671f-4f4a-868e-d52d66707466 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.766782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8fc9b-671f-4f4a-868e-d52d66707466 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.768436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 664/1335] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:26.774725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f9cf-1856-4f12-b9ff-c4aecd1b5ee2 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.775193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f9cf-1856-4f12-b9ff-c4aecd1b5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.775362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f9cf-1856-4f12-b9ff-c4aecd1b5ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.851450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-d052f9cf-1856-4f12-b9ff-c4aecd1b5ee2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:26.852672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d052f9cf-1856-4f12-b9ff-c4aecd1b5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:26.968699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 672/1336] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:27.256636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8fc9b-671f-4f4a-868e-d52d66707466 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:27.258201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-18c8fc9b-671f-4f4a-868e-d52d66707466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:27.302114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:27.370986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8fc9b-671f-4f4a-868e-d52d66707466 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:27.462581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:27.463217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:27.463538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:27.463766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:27.465369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:27.557616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:27.587828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:27.589285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8d2b-9f56-4a5f-97c8-8291d429880f service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:27.609113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 665/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:29.870311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3ef9-707e-4de2-9e44-ca1ab1c5eab4 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.871086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3ef9-707e-4de2-9e44-ca1ab1c5eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.871086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3ef9-707e-4de2-9e44-ca1ab1c5eab4 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.872380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 673/1338] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:29.879272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794029f4-5b16-4151-9fcb-f6d32f52e7f1 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:29.880060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794029f4-5b16-4151-9fcb-f6d32f52e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:29.880216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794029f4-5b16-4151-9fcb-f6d32f52e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:29.958752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-794029f4-5b16-4151-9fcb-f6d32f52e7f1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:29.960066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-794029f4-5b16-4151-9fcb-f6d32f52e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:30.067664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 666/1339] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:52:30.355622 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3ef9-707e-4de2-9e44-ca1ab1c5eab4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:30.357149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a67a3ef9-707e-4de2-9e44-ca1ab1c5eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:30.454335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.485456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3ef9-707e-4de2-9e44-ca1ab1c5eab4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:30.563715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:30.564565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:30.564963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:30.565384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:30.568044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:30.716375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:30.717763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6828b29-865c-428e-9d51-826025f6696e service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:30.736699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 674/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:34.799232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184aae1-2ed2-4187-a4a7-2526bda9f696 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.799862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184aae1-2ed2-4187-a4a7-2526bda9f696 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.799862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184aae1-2ed2-4187-a4a7-2526bda9f696 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.801640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 667/1341] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:34.807323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a83f2-ff90-4799-89b5-d078b4329f17 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:34.808053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a83f2-ff90-4799-89b5-d078b4329f17 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:34.808209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a83f2-ff90-4799-89b5-d078b4329f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:34.816481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:34.888844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-723a83f2-ff90-4799-89b5-d078b4329f17 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:34.890063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-723a83f2-ff90-4799-89b5-d078b4329f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:34.992668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 675/1342] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:35.275147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184aae1-2ed2-4187-a4a7-2526bda9f696 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:35.276886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4184aae1-2ed2-4187-a4a7-2526bda9f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:35.326132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.385947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184aae1-2ed2-4187-a4a7-2526bda9f696 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:35.462853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:35.463398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:35.463679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:35.463954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:35.465555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:35.566057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:35.584568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:35.586028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7b86d-38a1-48d8-bd48-672f02650d03 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:35.605182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 668/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:38.393011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ab3d1-0707-4233-9351-f31e97c85910 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.393595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ab3d1-0707-4233-9351-f31e97c85910 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.393595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ab3d1-0707-4233-9351-f31e97c85910 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.394948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 676/1344] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:38.400403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40fda-aaf6-498c-aba4-b378c669238e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:38.400836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40fda-aaf6-498c-aba4-b378c669238e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:38.401045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa40fda-aaf6-498c-aba4-b378c669238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:38.477475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7aa40fda-aaf6-498c-aba4-b378c669238e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:38.478931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7aa40fda-aaf6-498c-aba4-b378c669238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:38.581118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 669/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:38.865558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ab3d1-0707-4233-9351-f31e97c85910 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:38.867116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a80ab3d1-0707-4233-9351-f31e97c85910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:38.969505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:38.989038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ab3d1-0707-4233-9351-f31e97c85910 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:39.066832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:39.067800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:39.068067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:39.068334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:39.069911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:39.187790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:39.189582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e539b-ccf4-41b2-9ad8-68649b23c16c service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:39.210541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 677/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:43.364635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d8b7-1ff4-41e1-8664-b126243ce193 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.365193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d8b7-1ff4-41e1-8664-b126243ce193 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.365193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d8b7-1ff4-41e1-8664-b126243ce193 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.366540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 670/1347] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:43.372373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef23e1-60cb-4872-b536-ae084278c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:43.372939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef23e1-60cb-4872-b536-ae084278c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:43.372939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef23e1-60cb-4872-b536-ae084278c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:43.389156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.446403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-bfef23e1-60cb-4872-b536-ae084278c7d3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:43.447650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-bfef23e1-60cb-4872-b536-ae084278c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:43.552350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 678/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:43.840466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d8b7-1ff4-41e1-8664-b126243ce193 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:43.842014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-92f7d8b7-1ff4-41e1-8664-b126243ce193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:43.903789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.957915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d8b7-1ff4-41e1-8664-b126243ce193 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:44.038806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:44.039517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:44.039732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:44.040002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:44.041610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:44.151671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:44.156144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:44.157993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec6451-0b98-43e3-b27b-f5803d193faa service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:44.176614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 671/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:49.165136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfaeb-b2be-49d9-b94c-c69aa8c84a16 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.165136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfaeb-b2be-49d9-b94c-c69aa8c84a16 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.165136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfaeb-b2be-49d9-b94c-c69aa8c84a16 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.167415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 679/1350] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 09:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:49.176651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060576c-14ab-4459-b231-d83256adc782 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:49.176651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060576c-14ab-4459-b231-d83256adc782 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:49.176651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060576c-14ab-4459-b231-d83256adc782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:49.288310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e060576c-14ab-4459-b231-d83256adc782 None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:49.289515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e060576c-14ab-4459-b231-d83256adc782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:49.432841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 672/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 09:52:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:53.550586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=59 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:53.588949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022a57-8021-492f-bd2a-af3714381bd1 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.589202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022a57-8021-492f-bd2a-af3714381bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.589519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022a57-8021-492f-bd2a-af3714381bd1 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.591074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 680/1352] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 09:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:53.596396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ca2a-af92-48e9-b88d-b87916aee4c1 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:53.596923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ca2a-af92-48e9-b88d-b87916aee4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:53.597364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ca2a-af92-48e9-b88d-b87916aee4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:53.658517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:53.683728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7137ca2a-af92-48e9-b88d-b87916aee4c1 None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:53.685097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7137ca2a-af92-48e9-b88d-b87916aee4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:53.798922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 673/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:55.208056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b394-19b9-4817-8bf7-976f3b3f3a9c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.208612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b394-19b9-4817-8bf7-976f3b3f3a9c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.208612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b394-19b9-4817-8bf7-976f3b3f3a9c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.209976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 681/1354] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 09:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:55.215217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c31b-fbfb-41bc-9669-1aef24533619 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:55.215656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c31b-fbfb-41bc-9669-1aef24533619 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:55.215888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c31b-fbfb-41bc-9669-1aef24533619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:55.295172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9371c31b-fbfb-41bc-9669-1aef24533619 None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:55.296402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9371c31b-fbfb-41bc-9669-1aef24533619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:55.341939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:55.411138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 674/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:58.745002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314117d9-21e0-4189-a66c-5d9cc55e8042 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:58.745562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314117d9-21e0-4189-a66c-5d9cc55e8042 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:58.745562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314117d9-21e0-4189-a66c-5d9cc55e8042 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:58.746942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 682/1356] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:58.752665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4ae7-b7ec-4b24-ba26-99d9114714dc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:58.753062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4ae7-b7ec-4b24-ba26-99d9114714dc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:58.753348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4ae7-b7ec-4b24-ba26-99d9114714dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:58.836459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-63cc4ae7-b7ec-4b24-ba26-99d9114714dc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:58.837640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-63cc4ae7-b7ec-4b24-ba26-99d9114714dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:58.958901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 675/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:59.278424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6cffa-d8e0-4ce7-91be-c9280cd38a0a None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.278424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6cffa-d8e0-4ce7-91be-c9280cd38a0a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.278424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6cffa-d8e0-4ce7-91be-c9280cd38a0a None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.280536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 683/1358] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 09:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:52:59.292194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebfdad-dc7f-4110-aec9-413e40af70c5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.292918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebfdad-dc7f-4110-aec9-413e40af70c5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.293569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebfdad-dc7f-4110-aec9-413e40af70c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.322519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:59.404940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-12ebfdad-dc7f-4110-aec9-413e40af70c5 None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:59.406128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-12ebfdad-dc7f-4110-aec9-413e40af70c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:59.527086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 676/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 09:52:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:59.534953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6cffa-d8e0-4ce7-91be-c9280cd38a0a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:59.537005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6ec6cffa-d8e0-4ce7-91be-c9280cd38a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:59.717610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6cffa-d8e0-4ce7-91be-c9280cd38a0a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:59.809790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:59.853004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:59.853760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:59.854132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:59.854499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:59.856226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:59.951712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:59.953873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9aeaad-e6a7-461f-9b64-6c0ded58b90b service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:59.976764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 684/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:02.149018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9201422-b156-408c-9ff2-45140866a78d None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:02.149579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9201422-b156-408c-9ff2-45140866a78d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:02.149579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9201422-b156-408c-9ff2-45140866a78d None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:02.154921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 677/1361] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:02.156628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eab00-70aa-4862-ba3e-f763f087416b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:02.157066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eab00-70aa-4862-ba3e-f763f087416b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:02.157233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54eab00-70aa-4862-ba3e-f763f087416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:02.239415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b54eab00-70aa-4862-ba3e-f763f087416b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:02.240641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b54eab00-70aa-4862-ba3e-f763f087416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:02.283461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:02.358075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 685/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:02.655933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9201422-b156-408c-9ff2-45140866a78d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:02.657810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b9201422-b156-408c-9ff2-45140866a78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:02.742559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:02.829749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9201422-b156-408c-9ff2-45140866a78d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:02.961998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:02.962860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:02.963363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:02.963817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:02.965660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:02.995323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:03.084618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:03.086378 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f41f9-17ed-4e23-9149-51d89ff19337 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:03.109675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 678/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:05.349363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7fb08-4f38-400e-aa6e-970665b0758c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.349895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7fb08-4f38-400e-aa6e-970665b0758c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.349895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7fb08-4f38-400e-aa6e-970665b0758c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.351315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 686/1364] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:05.357199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10574b9-6fd5-4cfe-b55a-5868affc7389 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.357664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10574b9-6fd5-4cfe-b55a-5868affc7389 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.357750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10574b9-6fd5-4cfe-b55a-5868affc7389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.436205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f10574b9-6fd5-4cfe-b55a-5868affc7389 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:05.437424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f10574b9-6fd5-4cfe-b55a-5868affc7389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:05.543782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.551089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 679/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:05.836256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1ed6-88fa-4eae-ba41-9783e4bdfca1 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.836553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1ed6-88fa-4eae-ba41-9783e4bdfca1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.836798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1ed6-88fa-4eae-ba41-9783e4bdfca1 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.838316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 687/1366] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 09:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:05.844343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e229d-ec3d-4e3c-a751-8a693eb62b44 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.844689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e229d-ec3d-4e3c-a751-8a693eb62b44 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.845095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e229d-ec3d-4e3c-a751-8a693eb62b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.926560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a24e229d-ec3d-4e3c-a751-8a693eb62b44 None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:05.927806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a24e229d-ec3d-4e3c-a751-8a693eb62b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:06.051538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 680/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 09:53:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:06.060210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d1ed6-88fa-4eae-ba41-9783e4bdfca1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:06.061699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4d9d1ed6-88fa-4eae-ba41-9783e4bdfca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:06.235839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d1ed6-88fa-4eae-ba41-9783e4bdfca1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:06.259981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:06.364310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:06.365067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:06.365454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:06.365814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:06.367636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:06.465144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:06.466814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739bec8-f486-4e21-ab8b-6738be783697 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:06.485704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 688/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:53:07.019178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7570ef-c42f-4c5b-a7b0-a801d8f257fa None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.019755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7570ef-c42f-4c5b-a7b0-a801d8f257fa None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.019755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7570ef-c42f-4c5b-a7b0-a801d8f257fa None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.021240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 681/1369] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:07.026455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5d682-555e-45c1-8e5a-95272b87a8ce None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.026737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5d682-555e-45c1-8e5a-95272b87a8ce None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.027009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5d682-555e-45c1-8e5a-95272b87a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.059379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.096957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-16d5d682-555e-45c1-8e5a-95272b87a8ce None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:07.098214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-16d5d682-555e-45c1-8e5a-95272b87a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:07.221669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 689/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:07.802627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ceb3-6637-4357-9a04-a3403ab34953 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.802627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ceb3-6637-4357-9a04-a3403ab34953 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.802627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ceb3-6637-4357-9a04-a3403ab34953 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.805230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 682/1371] 10.222.0.65 () {54 vars in 964 bytes} [Wed Aug 24 09:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:07.809289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6176e5-1c75-414c-9e18-b2764a162a1b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:07.810481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6176e5-1c75-414c-9e18-b2764a162a1b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:07.810481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6176e5-1c75-414c-9e18-b2764a162a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:07.895667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6d6176e5-1c75-414c-9e18-b2764a162a1b None None] MFA Rules not processed for user `fc76f59ac1054c18a5e03cc0a18db502`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:07.897019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6d6176e5-1c75-414c-9e18-b2764a162a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:07.951883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:07.985042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 690/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Aug 24 09:53:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:07.993303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95ceb3-6637-4357-9a04-a3403ab34953 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:07.994811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fc95ceb3-6637-4357-9a04-a3403ab34953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:08.052822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.116624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95ceb3-6637-4357-9a04-a3403ab34953 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.200608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.201370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.201554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.201882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.208226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:08.321737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.334999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.336574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5729bb5-9b3e-4dd6-bb59-2d271f8cf201 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.369564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 683/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:08.525850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a0928-c663-40e5-8570-1ca03075dcbb None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.526058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a0928-c663-40e5-8570-1ca03075dcbb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.526304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a0928-c663-40e5-8570-1ca03075dcbb None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.527678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 691/1374] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:08.533110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef07b2e-49ff-4d1d-b60d-9e88c4ea7baa None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.533456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef07b2e-49ff-4d1d-b60d-9e88c4ea7baa None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.533731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef07b2e-49ff-4d1d-b60d-9e88c4ea7baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.600090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9ef07b2e-49ff-4d1d-b60d-9e88c4ea7baa None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:08.601317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9ef07b2e-49ff-4d1d-b60d-9e88c4ea7baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:08.705233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 684/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:53:08.998257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a0928-c663-40e5-8570-1ca03075dcbb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:09.000013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e5a0928-c663-40e5-8570-1ca03075dcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:09.160293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a0928-c663-40e5-8570-1ca03075dcbb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:09.218962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:09.281240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:09.281741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:09.282018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:09.282289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:09.283957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:09.379700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:09.381455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f29e54-a6e2-4010-9080-7c69382509fc service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:09.400128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 692/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:11.359596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc04552-8bc9-4ded-9097-53981cb90361 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.360134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc04552-8bc9-4ded-9097-53981cb90361 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.360134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc04552-8bc9-4ded-9097-53981cb90361 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.361861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 685/1377] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:11.367653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70675cb3-04de-47bb-9bce-f59f231a055a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:11.368620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70675cb3-04de-47bb-9bce-f59f231a055a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:11.369048 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70675cb3-04de-47bb-9bce-f59f231a055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:11.446949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-70675cb3-04de-47bb-9bce-f59f231a055a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:11.448367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-70675cb3-04de-47bb-9bce-f59f231a055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:11.456136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:11.567856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 693/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:11.871110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc04552-8bc9-4ded-9097-53981cb90361 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:11.873683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dfc04552-8bc9-4ded-9097-53981cb90361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:11.959246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.071228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc04552-8bc9-4ded-9097-53981cb90361 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:12.198400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:12.199332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:12.199788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:12.200271 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:12.202050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:12.226239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:12.301700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:12.303339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86399e4-c4ad-4268-9bf6-b2b27f10b8a4 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:12.324357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 686/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:14.294406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9448eb-66d6-463f-a794-d72f5cf72d40 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.294922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9448eb-66d6-463f-a794-d72f5cf72d40 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.294922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9448eb-66d6-463f-a794-d72f5cf72d40 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.296469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 694/1380] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:14.301693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de214833-513a-48a4-8cad-d684fad91f19 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:14.302137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de214833-513a-48a4-8cad-d684fad91f19 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:14.302411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de214833-513a-48a4-8cad-d684fad91f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:14.375927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-de214833-513a-48a4-8cad-d684fad91f19 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:14.377567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-de214833-513a-48a4-8cad-d684fad91f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:14.485709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.494063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 687/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:14.803037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9448eb-66d6-463f-a794-d72f5cf72d40 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:14.804597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-de9448eb-66d6-463f-a794-d72f5cf72d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:15.002197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:15.019233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9448eb-66d6-463f-a794-d72f5cf72d40 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:15.171422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:15.172061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:15.172339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:15.172608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:15.174374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:15.285388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:15.287017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e873e-0844-4ff0-966d-a069b6753723 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:15.301124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:15.311851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 695/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:53:17.458409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805d60-77ef-4f27-b167-0a711ae6d8fd None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.458986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805d60-77ef-4f27-b167-0a711ae6d8fd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.459210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805d60-77ef-4f27-b167-0a711ae6d8fd None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.461297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 688/1383] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:17.467279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77c44e-5762-4d47-a241-7322b081a0f1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:17.467720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77c44e-5762-4d47-a241-7322b081a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:17.467816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77c44e-5762-4d47-a241-7322b081a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:17.544987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2d77c44e-5762-4d47-a241-7322b081a0f1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:17.546798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2d77c44e-5762-4d47-a241-7322b081a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:17.677807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 696/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:17.974314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22805d60-77ef-4f27-b167-0a711ae6d8fd None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:17.976119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-22805d60-77ef-4f27-b167-0a711ae6d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:18.147911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22805d60-77ef-4f27-b167-0a711ae6d8fd None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.223088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.285280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.285971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.286262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.286544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.288368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:18.405960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.408034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf767e-bd9c-4a18-8037-65d2beca2ae6 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.429538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 689/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:20.463344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a390c-fda1-4ab9-a063-63dae586b920 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.463946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a390c-fda1-4ab9-a063-63dae586b920 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.463946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a390c-fda1-4ab9-a063-63dae586b920 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.466155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 697/1386] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:20.473224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5fd9-cb66-4fa1-bdd0-5031ab183180 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:20.473881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5fd9-cb66-4fa1-bdd0-5031ab183180 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:20.473881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f5fd9-cb66-4fa1-bdd0-5031ab183180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:20.552682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-1f6f5fd9-cb66-4fa1-bdd0-5031ab183180 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:20.553995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1f6f5fd9-cb66-4fa1-bdd0-5031ab183180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:20.588936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:20.670198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 690/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:20.978792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a390c-fda1-4ab9-a063-63dae586b920 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:20.980493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e55a390c-fda1-4ab9-a063-63dae586b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:21.076352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.155654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a390c-fda1-4ab9-a063-63dae586b920 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.298077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.298839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.299167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.299445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.301212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:21.344192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.403791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:21.405564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec62261-929f-4b84-97ab-cbbb09cfebe1 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.425689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 698/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:23.443724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e5db-2f26-42fe-aa64-4f0a268b7fba None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.444609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e5db-2f26-42fe-aa64-4f0a268b7fba None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.444609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e5db-2f26-42fe-aa64-4f0a268b7fba None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.446088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 691/1389] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:23.451759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3875-b09a-4902-ad24-a7654cdd00a4 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.452228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3875-b09a-4902-ad24-a7654cdd00a4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.452333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3875-b09a-4902-ad24-a7654cdd00a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.524342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f0ce3875-b09a-4902-ad24-a7654cdd00a4 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:23.525475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f0ce3875-b09a-4902-ad24-a7654cdd00a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:23.631069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 699/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:23.883319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3248127-1d2a-471c-bc9d-9ab107ea3fab None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.883633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3248127-1d2a-471c-bc9d-9ab107ea3fab None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.883830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3248127-1d2a-471c-bc9d-9ab107ea3fab None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.885460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 692/1391] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:23.890775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70abf-4c26-4cb1-b8ef-982592eaed2a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.891109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70abf-4c26-4cb1-b8ef-982592eaed2a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.891529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70abf-4c26-4cb1-b8ef-982592eaed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.909499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.921465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3248127-1d2a-471c-bc9d-9ab107ea3fab None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.923011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a3248127-1d2a-471c-bc9d-9ab107ea3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:23.965420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-d7b70abf-4c26-4cb1-b8ef-982592eaed2a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:23.966642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d7b70abf-4c26-4cb1-b8ef-982592eaed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:24.067972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 700/1392] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:24.082875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3248127-1d2a-471c-bc9d-9ab107ea3fab None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.101714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.209793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.209965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.210222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.210495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.212192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:24.311407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.313034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af11d50-02a7-4f74-aac1-b1e08cb1b5a7 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.333316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 693/1393] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:24.376180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff482-087e-4805-aa32-ea9caa292044 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.376465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff482-087e-4805-aa32-ea9caa292044 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.376739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff482-087e-4805-aa32-ea9caa292044 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.378638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 701/1394] 10.222.0.65 () {54 vars in 967 bytes} [Wed Aug 24 09:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:24.384541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c026-7653-40f9-bdfb-71659f87004e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.384898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c026-7653-40f9-bdfb-71659f87004e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.385406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c026-7653-40f9-bdfb-71659f87004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.414546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.479107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-6823c026-7653-40f9-bdfb-71659f87004e None None] MFA Rules not processed for user `c0a103b9b799406fab32d0eaa4965592`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:24.480308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6823c026-7653-40f9-bdfb-71659f87004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:24.568478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 694/1395] 10.222.0.65 () {58 vars in 1064 bytes} [Wed Aug 24 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:53:24.576528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff482-087e-4805-aa32-ea9caa292044 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:24.578018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d6dff482-087e-4805-aa32-ea9caa292044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:24.682646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:24.691268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff482-087e-4805-aa32-ea9caa292044 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:24.770336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:24.770859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:24.771163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:24.771429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:24.773016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:24.886510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:24.888026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fa81a-0240-4821-9aab-50e5ecf3587a service glance] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:24.906836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 702/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:53:25.669900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793905-06d6-4c77-b02f-1fda8cb4a8ea None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.670425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793905-06d6-4c77-b02f-1fda8cb4a8ea None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.670425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9793905-06d6-4c77-b02f-1fda8cb4a8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.741724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e9793905-06d6-4c77-b02f-1fda8cb4a8ea None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:25.742948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e9793905-06d6-4c77-b02f-1fda8cb4a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:25.810187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:25.840757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 695/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:25.884509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3439c3-fc3c-421e-a0f4-50443ed06f49 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.885060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3439c3-fc3c-421e-a0f4-50443ed06f49 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.885060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3439c3-fc3c-421e-a0f4-50443ed06f49 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.886446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 703/1398] 10.222.0.65 () {54 vars in 943 bytes} [Wed Aug 24 09:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:25.892936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e95b0-bc7a-4617-99c3-51fa7b649aba None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.893221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e95b0-bc7a-4617-99c3-51fa7b649aba None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.893514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e95b0-bc7a-4617-99c3-51fa7b649aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.972768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-886e95b0-bc7a-4617-99c3-51fa7b649aba None None] MFA Rules not processed for user `3592ce2e44b3470b8a5299295364031d`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:25.973870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-886e95b0-bc7a-4617-99c3-51fa7b649aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:26.088138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 696/1399] 10.222.0.65 () {58 vars in 1040 bytes} [Wed Aug 24 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:26.098179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3439c3-fc3c-421e-a0f4-50443ed06f49 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:26.099794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6a3439c3-fc3c-421e-a0f4-50443ed06f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:26.126384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.246156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3439c3-fc3c-421e-a0f4-50443ed06f49 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:26.355974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:26.356585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.356865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.357135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.358772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:26.360951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97317d-a2a6-45fb-a34f-db099f42e651 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.361209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97317d-a2a6-45fb-a34f-db099f42e651 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.361577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97317d-a2a6-45fb-a34f-db099f42e651 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.363116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 697/1400] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:53:26.366678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.368273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39f88-83c8-4c4f-bcee-541c9c34ab02 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:26.368587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39f88-83c8-4c4f-bcee-541c9c34ab02 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:26.368831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39f88-83c8-4c4f-bcee-541c9c34ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:26.414001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:26.436783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7bf39f88-83c8-4c4f-bcee-541c9c34ab02 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:26.438003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7bf39f88-83c8-4c4f-bcee-541c9c34ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:26.448519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:26.450129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:26.458851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 704/1401] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 09:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:53:26.547817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 698/1402] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:53:26.845494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:26.847552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:26.950549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0654b-db80-46b1-9683-3de2499198b5 service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:27.017247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:27.087290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:27.087850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:27.088102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:27.088374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:27.090018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:27.198976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:27.200830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a487-d584-4536-96c6-bca7c3a91ced service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:27.240495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 705/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:53:29.261725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff4f1-1cf9-40b8-8a96-927bd050fb1e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:29.264827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff4f1-1cf9-40b8-8a96-927bd050fb1e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:29.264827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff4f1-1cf9-40b8-8a96-927bd050fb1e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:29.264827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 699/1404] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:29.270813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff456c-647c-449c-b924-c7f60dceb27b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:29.271402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff456c-647c-449c-b924-c7f60dceb27b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:29.271402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff456c-647c-449c-b924-c7f60dceb27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:29.354216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-22ff456c-647c-449c-b924-c7f60dceb27b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:29.355480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-22ff456c-647c-449c-b924-c7f60dceb27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:29.380842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:29.481851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 706/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:29.768981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff4f1-1cf9-40b8-8a96-927bd050fb1e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:29.770509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-990ff4f1-1cf9-40b8-8a96-927bd050fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:29.904634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:29.947340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff4f1-1cf9-40b8-8a96-927bd050fb1e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:30.110442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:30.111087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:30.111375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:30.111791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:30.114016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:30.220055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:30.248194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:30.251962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78da8a-503c-4833-bc7e-5f3143a23b68 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:30.273360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 700/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:32.279240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366dc2e-be6d-4da3-af3f-51bcae3c7ecf None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.279836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366dc2e-be6d-4da3-af3f-51bcae3c7ecf None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.279836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366dc2e-be6d-4da3-af3f-51bcae3c7ecf None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.281126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 707/1407] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:32.286876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d60f-c21b-4863-af9a-81501a515a6a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:32.287407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d60f-c21b-4863-af9a-81501a515a6a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:32.287500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261d60f-c21b-4863-af9a-81501a515a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:32.360039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f261d60f-c21b-4863-af9a-81501a515a6a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:32.361293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f261d60f-c21b-4863-af9a-81501a515a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:32.466488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 701/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:32.765710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366dc2e-be6d-4da3-af3f-51bcae3c7ecf None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:32.767311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c366dc2e-be6d-4da3-af3f-51bcae3c7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:32.933924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.937382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366dc2e-be6d-4da3-af3f-51bcae3c7ecf None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:33.063248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:33.064303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:33.064869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:33.065294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:33.066962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:33.176490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:33.178121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c180b-75e5-4008-bf90-8f7ccb7e442d service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:33.197488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 708/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:42.464736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=76 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:43.194521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:48.540850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8eda-dc8e-4ab2-a2ec-c40dff732f64 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.541539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8eda-dc8e-4ab2-a2ec-c40dff732f64 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.541539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8eda-dc8e-4ab2-a2ec-c40dff732f64 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.542627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 702/1410] 10.222.0.65 () {54 vars in 918 bytes} [Wed Aug 24 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:48.548887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1452-84e4-4ebc-9042-866419582b2a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.549626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1452-84e4-4ebc-9042-866419582b2a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.549626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1452-84e4-4ebc-9042-866419582b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.642459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-179e1452-84e4-4ebc-9042-866419582b2a None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:48.644203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-179e1452-84e4-4ebc-9042-866419582b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:48.771981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 709/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Aug 24 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:48.789927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4c78-22cb-4dd0-a038-54a75c989d89 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.790305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4c78-22cb-4dd0-a038-54a75c989d89 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.790665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4c78-22cb-4dd0-a038-54a75c989d89 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.792872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 703/1412] 10.222.0.65 () {54 vars in 918 bytes} [Wed Aug 24 09:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:48.797832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ffa9-76a8-4836-88e8-f07f6239e820 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.798117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ffa9-76a8-4836-88e8-f07f6239e820 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.798391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ffa9-76a8-4836-88e8-f07f6239e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.879227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:48.884326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1437ffa9-76a8-4836-88e8-f07f6239e820 None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:48.887242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1437ffa9-76a8-4836-88e8-f07f6239e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:49.026211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 710/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Aug 24 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:51.484205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb748a6-2efc-4ecc-88b4-7631e30500ee None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:51.484744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb748a6-2efc-4ecc-88b4-7631e30500ee None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:51.484744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb748a6-2efc-4ecc-88b4-7631e30500ee None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:51.486001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:51.494669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2670-1680-4d4b-bd64-0591e920c81e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:51.495246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2670-1680-4d4b-bd64-0591e920c81e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:51.495246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b2670-1680-4d4b-bd64-0591e920c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:51.576690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-185b2670-1680-4d4b-bd64-0591e920c81e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:51.577914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-185b2670-1680-4d4b-bd64-0591e920c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:51.638253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:51.687242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:51.980811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb748a6-2efc-4ecc-88b4-7631e30500ee None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:51.982407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6fb748a6-2efc-4ecc-88b4-7631e30500ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:52.142579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb748a6-2efc-4ecc-88b4-7631e30500ee None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:52.225904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:52.274866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:52.275507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:52.275787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:52.276058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:52.277667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:52.369186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:52.370787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6409-635b-48e6-a6ab-3547b583be9a service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:52.396874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 705/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:53.313581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0c01-9988-445b-920b-f67788ca2927 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.314140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0c01-9988-445b-920b-f67788ca2927 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.314140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0c01-9988-445b-920b-f67788ca2927 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.315503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:53.320941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb320-4a19-49ff-acf7-8978149bfdfe None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.321692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb320-4a19-49ff-acf7-8978149bfdfe None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.321784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb320-4a19-49ff-acf7-8978149bfdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.400318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d44eb320-4a19-49ff-acf7-8978149bfdfe None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:53.401518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d44eb320-4a19-49ff-acf7-8978149bfdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:53.429544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:53.504511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:53.659538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d0c01-9988-445b-920b-f67788ca2927 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:53.661530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-017d0c01-9988-445b-920b-f67788ca2927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:53.820527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d0c01-9988-445b-920b-f67788ca2927 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:53.864725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:53.944682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:53.945294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:53.945569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:53.945837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:53.947822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:54.042537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:54.044071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb33de-9159-4284-8320-c8d256b19ca0 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:54.063079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 713/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:54.966883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224637-5ff8-4e49-8119-833502faafee None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:54.967492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224637-5ff8-4e49-8119-833502faafee None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:54.967619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224637-5ff8-4e49-8119-833502faafee None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:54.968950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:54.974420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f433f-2ff2-488b-8fa5-0aae63503a1a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:54.974873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f433f-2ff2-488b-8fa5-0aae63503a1a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:54.974985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f433f-2ff2-488b-8fa5-0aae63503a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:55.030480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:55.054633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c51f433f-2ff2-488b-8fa5-0aae63503a1a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:55.055903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c51f433f-2ff2-488b-8fa5-0aae63503a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:55.160793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:55.319804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224637-5ff8-4e49-8119-833502faafee None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:55.321851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-92224637-5ff8-4e49-8119-833502faafee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:55.472622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224637-5ff8-4e49-8119-833502faafee None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:55.484810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:55.593501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:55.594018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:55.594295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:55.594567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:55.596212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:55.687945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:55.689579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5862-3747-4c0f-89d1-63715acd6e22 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:55.708793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 708/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:56.570243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af99a5-1689-4def-a17e-3bc0a3cac224 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.570807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af99a5-1689-4def-a17e-3bc0a3cac224 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.570807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af99a5-1689-4def-a17e-3bc0a3cac224 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.572578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:56.577905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d60be6-5fa9-454f-9baf-32377d07d408 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:56.578362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d60be6-5fa9-454f-9baf-32377d07d408 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:56.578454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d60be6-5fa9-454f-9baf-32377d07d408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:56.600003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:56.671660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-29d60be6-5fa9-454f-9baf-32377d07d408 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:56.672885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-29d60be6-5fa9-454f-9baf-32377d07d408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:56.775740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:56.933553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af99a5-1689-4def-a17e-3bc0a3cac224 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:56.935636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-53af99a5-1689-4def-a17e-3bc0a3cac224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:57.053876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:57.091732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af99a5-1689-4def-a17e-3bc0a3cac224 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:57.223353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:57.223949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:57.224246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:57.224528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:57.226124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:57.304457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:57.319695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:57.321315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbfcb5-1bb0-4e0c-83bb-034e1be12963 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:57.341612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 716/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:58.195869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a694f-5ef7-4e2d-b76b-ed34c7f217ec None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:58.196490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a694f-5ef7-4e2d-b76b-ed34c7f217ec None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:58.196490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a694f-5ef7-4e2d-b76b-ed34c7f217ec None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:58.198060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:58.203606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cab52a-9adc-46ac-8462-bac40d2817f3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:58.204037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cab52a-9adc-46ac-8462-bac40d2817f3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:58.204139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cab52a-9adc-46ac-8462-bac40d2817f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:58.283860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-99cab52a-9adc-46ac-8462-bac40d2817f3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:58.285278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-99cab52a-9adc-46ac-8462-bac40d2817f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:58.388545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:58.546680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a694f-5ef7-4e2d-b76b-ed34c7f217ec None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:58.548149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ed7a694f-5ef7-4e2d-b76b-ed34c7f217ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:58.639310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:58.708701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a694f-5ef7-4e2d-b76b-ed34c7f217ec None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:58.827215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:58.827829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:58.828107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:58.828377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:58.829969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:58.879953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:58.929318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:58.930962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521948d-fcef-448a-918a-7fe92b2a7680 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:58.950755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 711/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:59.762399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5727-7d84-4785-8084-0ebbcfa6c020 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.762998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5727-7d84-4785-8084-0ebbcfa6c020 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.762998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c5727-7d84-4785-8084-0ebbcfa6c020 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.764358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:53:59.769639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7a5-4aad-420d-837f-56ef2458f38a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.770260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7a5-4aad-420d-837f-56ef2458f38a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.770260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7a5-4aad-420d-837f-56ef2458f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.852291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c38af7a5-4aad-420d-837f-56ef2458f38a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:59.853567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c38af7a5-4aad-420d-837f-56ef2458f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:59.950478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:00.099949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c5727-7d84-4785-8084-0ebbcfa6c020 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:00.101483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4e8c5727-7d84-4785-8084-0ebbcfa6c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:00.152001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:00.251851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c5727-7d84-4785-8084-0ebbcfa6c020 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:00.386875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:00.387597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:00.388047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:00.388447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:00.391013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:00.400304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:00.497601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:00.499263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c505-894a-4718-a00b-229326bdd08d service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:00.519527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 719/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:01.344318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9d661-d2eb-4c4c-b736-20b98726a423 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:01.345128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9d661-d2eb-4c4c-b736-20b98726a423 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:01.345276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9d661-d2eb-4c4c-b736-20b98726a423 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:01.347171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:01.355669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5f59-c3af-4e34-bb41-a3a007648915 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:01.356284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5f59-c3af-4e34-bb41-a3a007648915 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:01.356284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5f59-c3af-4e34-bb41-a3a007648915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:01.444050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-959e5f59-c3af-4e34-bb41-a3a007648915 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:01.445267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-959e5f59-c3af-4e34-bb41-a3a007648915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:01.517289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:01.548596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:01.701820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9d661-d2eb-4c4c-b736-20b98726a423 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:01.703546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a1a9d661-d2eb-4c4c-b736-20b98726a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:01.723204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:01.864857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9d661-d2eb-4c4c-b736-20b98726a423 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:01.955799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:01.989617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:01.990648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:01.991195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:01.991664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:01.994296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:02.104995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:02.107589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b9149-b0cd-4987-a833-1cf50d92de8e service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:02.131420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 714/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:02.959100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f2cb-bfbd-4da9-8dbd-b33c07d10602 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:02.959677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f2cb-bfbd-4da9-8dbd-b33c07d10602 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:02.960010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f2cb-bfbd-4da9-8dbd-b33c07d10602 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:02.961449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:02.967524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fdfd-6ade-4296-b574-8a6aee2928c2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:02.968099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fdfd-6ade-4296-b574-8a6aee2928c2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:02.968099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fdfd-6ade-4296-b574-8a6aee2928c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:03.050205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-78d8fdfd-6ade-4296-b574-8a6aee2928c2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:03.051617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-78d8fdfd-6ade-4296-b574-8a6aee2928c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:03.096074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:03.157042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:03.308655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f2cb-bfbd-4da9-8dbd-b33c07d10602 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:03.310320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e014f2cb-bfbd-4da9-8dbd-b33c07d10602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:03.463157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f2cb-bfbd-4da9-8dbd-b33c07d10602 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:03.519136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:03.586010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:03.586623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:03.586903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:03.587198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:03.588830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:03.681382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:03.683000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f7cd0-dce1-43ba-8bc8-b277e598d82d service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:03.702244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 722/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:04.535609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cb027-6bc5-4a1c-90ab-4e7b8c198996 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:04.536075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cb027-6bc5-4a1c-90ab-4e7b8c198996 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:04.536347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cb027-6bc5-4a1c-90ab-4e7b8c198996 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:04.537799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:04.543292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543838f3-cead-4f5a-9a98-e6b349728811 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:04.544829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543838f3-cead-4f5a-9a98-e6b349728811 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:04.544829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543838f3-cead-4f5a-9a98-e6b349728811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:04.640565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-543838f3-cead-4f5a-9a98-e6b349728811 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:04.641807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-543838f3-cead-4f5a-9a98-e6b349728811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:04.643897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:04.755829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:04.905505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cb027-6bc5-4a1c-90ab-4e7b8c198996 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:04.907038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-eb6cb027-6bc5-4a1c-90ab-4e7b8c198996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:05.069511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cb027-6bc5-4a1c-90ab-4e7b8c198996 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:05.101241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:05.195339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:05.195962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:05.196237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:05.196505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:05.198423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:05.304503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:05.306127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce03a4-ea95-4b9f-b494-8865512f91c5 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:05.325343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 717/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:07.191399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2025ae3-7190-4138-aabc-055eece29e79 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:07.192540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2025ae3-7190-4138-aabc-055eece29e79 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:07.192540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2025ae3-7190-4138-aabc-055eece29e79 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:07.193351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:07.199794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471d82-3cad-48c8-94fc-691419aa2113 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:07.200305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471d82-3cad-48c8-94fc-691419aa2113 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:07.200305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34471d82-3cad-48c8-94fc-691419aa2113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:07.245897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:07.274488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-34471d82-3cad-48c8-94fc-691419aa2113 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:07.275734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-34471d82-3cad-48c8-94fc-691419aa2113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:07.380187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:07.663388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2025ae3-7190-4138-aabc-055eece29e79 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:07.664938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c2025ae3-7190-4138-aabc-055eece29e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:07.776223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2025ae3-7190-4138-aabc-055eece29e79 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:07.810255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:07.856348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:07.857043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:07.857346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:07.857619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:07.859427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:07.981711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:07.983083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52fc90-9992-4f6e-800c-2d31e4f60e0d service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:08.002304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 725/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:10.104179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20705d-cfe3-49df-884a-12a57bc1552e None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.104809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20705d-cfe3-49df-884a-12a57bc1552e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.104809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20705d-cfe3-49df-884a-12a57bc1552e None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.106146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:10.112021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4408a6-dbcc-4b75-a4ea-ad8655d7a219 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.112505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4408a6-dbcc-4b75-a4ea-ad8655d7a219 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.112505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4408a6-dbcc-4b75-a4ea-ad8655d7a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.181647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0e4408a6-dbcc-4b75-a4ea-ad8655d7a219 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:10.182873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0e4408a6-dbcc-4b75-a4ea-ad8655d7a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.198492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:10.286868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:10.582488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20705d-cfe3-49df-884a-12a57bc1552e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.585205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ce20705d-cfe3-49df-884a-12a57bc1552e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.698213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20705d-cfe3-49df-884a-12a57bc1552e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.710824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:10.785314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.786411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.786700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.786962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.788634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.920847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.922251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6de7e1-b39a-411b-9b46-3be8687de79d service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.943133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 720/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:13.206017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4f73-2a36-4d4f-905c-df1003009a26 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.206634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4f73-2a36-4d4f-905c-df1003009a26 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.206735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4f73-2a36-4d4f-905c-df1003009a26 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.208338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:13.214916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef77f37-e58a-4a6b-9e1b-bdc78e73f404 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.215503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef77f37-e58a-4a6b-9e1b-bdc78e73f404 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.215503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef77f37-e58a-4a6b-9e1b-bdc78e73f404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.268336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:13.288202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cef77f37-e58a-4a6b-9e1b-bdc78e73f404 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:13.289457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cef77f37-e58a-4a6b-9e1b-bdc78e73f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:13.392880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:13.683823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4f73-2a36-4d4f-905c-df1003009a26 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:13.685385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-127b4f73-2a36-4d4f-905c-df1003009a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:13.808046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4f73-2a36-4d4f-905c-df1003009a26 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:13.853223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:13.890201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:13.890818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.891137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.891415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.893036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.015356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.016724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89591d4d-89b5-464d-8c70-e8f09320fd87 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.041369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 728/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:16.265359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d98b2-2ab9-40f2-a9bd-b02d64fbb032 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.265913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d98b2-2ab9-40f2-a9bd-b02d64fbb032 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.265913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d98b2-2ab9-40f2-a9bd-b02d64fbb032 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.267402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:16.273694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0838b-444d-434c-8728-1ecdd0466e46 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.274197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0838b-444d-434c-8728-1ecdd0466e46 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.274197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0838b-444d-434c-8728-1ecdd0466e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.361156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-01a0838b-444d-434c-8728-1ecdd0466e46 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:16.363251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-01a0838b-444d-434c-8728-1ecdd0466e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:16.388083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:16.502024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:16.807720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d98b2-2ab9-40f2-a9bd-b02d64fbb032 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.809301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a28d98b2-2ab9-40f2-a9bd-b02d64fbb032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:16.929046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d98b2-2ab9-40f2-a9bd-b02d64fbb032 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.950513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:17.010515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:17.011162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:17.011468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:17.011737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:17.013338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:17.135007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:17.136493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c58b1-d500-40ca-bf4d-d487aa3a3a37 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:17.155768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 723/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:19.157983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663003fe-8f3e-421d-a636-61b0a1b3be18 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:19.158755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663003fe-8f3e-421d-a636-61b0a1b3be18 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:19.158755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663003fe-8f3e-421d-a636-61b0a1b3be18 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:19.161193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:19.170376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6102-b207-44e2-a997-554bdd6ce175 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:19.170897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6102-b207-44e2-a997-554bdd6ce175 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:19.171410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e6102-b207-44e2-a997-554bdd6ce175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:19.245327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:19.248305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-8f2e6102-b207-44e2-a997-554bdd6ce175 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:19.250510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8f2e6102-b207-44e2-a997-554bdd6ce175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:19.366347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:19.670601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663003fe-8f3e-421d-a636-61b0a1b3be18 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:19.672195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-663003fe-8f3e-421d-a636-61b0a1b3be18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:19.793131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663003fe-8f3e-421d-a636-61b0a1b3be18 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:19.850951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:19.879539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:19.880286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:19.880673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:19.881040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:19.883513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:20.023873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:20.025239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98034c89-5f90-4b76-a8f4-5317d585907d service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:20.046557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 731/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:22.060406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f072e0-e0d1-4bb0-9ff6-cd184e4b369c None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:22.060959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f072e0-e0d1-4bb0-9ff6-cd184e4b369c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:22.060959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f072e0-e0d1-4bb0-9ff6-cd184e4b369c None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:22.062330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:22.068111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc401-67d7-440d-a809-fb166e17033c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:22.069248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc401-67d7-440d-a809-fb166e17033c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:22.069248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc401-67d7-440d-a809-fb166e17033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:22.139475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-263bc401-67d7-440d-a809-fb166e17033c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:22.140694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-263bc401-67d7-440d-a809-fb166e17033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:22.170291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:22.247289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:22.533295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f072e0-e0d1-4bb0-9ff6-cd184e4b369c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:22.535076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-73f072e0-e0d1-4bb0-9ff6-cd184e4b369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:22.653398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f072e0-e0d1-4bb0-9ff6-cd184e4b369c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:22.688313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:22.756602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:22.757227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:22.757511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:22.757783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:22.759494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:22.886312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:22.887793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa70f52-1934-442f-867f-8d41c9b1cadb service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:22.906696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 726/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:25.011360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f348fc-274c-4772-94ed-cf0ae5632e2d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:25.011935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f348fc-274c-4772-94ed-cf0ae5632e2d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:25.011935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f348fc-274c-4772-94ed-cf0ae5632e2d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:25.013358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:25.020155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132687-3257-4c28-897e-33f71e4246b3 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:25.020660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132687-3257-4c28-897e-33f71e4246b3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:25.020660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132687-3257-4c28-897e-33f71e4246b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:25.109980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-35132687-3257-4c28-897e-33f71e4246b3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:25.111824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-35132687-3257-4c28-897e-33f71e4246b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:25.122132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:25.246756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:25.537905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f348fc-274c-4772-94ed-cf0ae5632e2d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:25.540331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-52f348fc-274c-4772-94ed-cf0ae5632e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:25.658293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f348fc-274c-4772-94ed-cf0ae5632e2d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:25.724624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:25.750022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:25.750641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:25.750916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:25.751221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:25.754006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:25.878500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:25.879988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c6bc-d2ed-432d-b516-0229f19ed963 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:25.899472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 734/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:27.864203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed7ef-382a-4783-ac2c-da0b46be88b1 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:27.865026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed7ef-382a-4783-ac2c-da0b46be88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:27.865026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed7ef-382a-4783-ac2c-da0b46be88b1 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:27.866543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:27.872188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106467bd-ed39-41de-888e-c26dafeacdba None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:27.872612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106467bd-ed39-41de-888e-c26dafeacdba None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:27.872749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106467bd-ed39-41de-888e-c26dafeacdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:27.952839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-106467bd-ed39-41de-888e-c26dafeacdba None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:27.954076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-106467bd-ed39-41de-888e-c26dafeacdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:27.995578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:28.066504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:28.351468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed7ef-382a-4783-ac2c-da0b46be88b1 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:28.353202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a01ed7ef-382a-4783-ac2c-da0b46be88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:28.476972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed7ef-382a-4783-ac2c-da0b46be88b1 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:28.516612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:28.566508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:28.567263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:28.567624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:28.567977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:28.570515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:28.703908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:28.705269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3ea1-b34e-49b6-9c67-c683bb22bb5b service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:28.724283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 729/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:30.688752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458f56-2589-4d2b-92b7-29e98d7f4ae0 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:30.689421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458f56-2589-4d2b-92b7-29e98d7f4ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:30.689421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458f56-2589-4d2b-92b7-29e98d7f4ae0 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:30.690712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:30.696639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f01fef-3888-41f1-8beb-b7d31883d2c7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:30.697422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f01fef-3888-41f1-8beb-b7d31883d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:30.697422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f01fef-3888-41f1-8beb-b7d31883d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:30.773359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-40f01fef-3888-41f1-8beb-b7d31883d2c7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:30.774581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-40f01fef-3888-41f1-8beb-b7d31883d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:30.795200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:30.879565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:31.165792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458f56-2589-4d2b-92b7-29e98d7f4ae0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:31.168275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8c458f56-2589-4d2b-92b7-29e98d7f4ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:31.284595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458f56-2589-4d2b-92b7-29e98d7f4ae0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:31.366355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:31.373865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:31.374470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:31.374744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:31.375010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:31.376872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:31.492811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:31.494159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea99e-4a9e-4c7d-8cba-bf3b96e95dc1 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:31.514596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 737/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:33.423182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb340d-79c5-4f84-9e76-8ed121141f69 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:33.423928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb340d-79c5-4f84-9e76-8ed121141f69 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:33.424109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb340d-79c5-4f84-9e76-8ed121141f69 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:33.425522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:54:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:33.431092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6abac-9481-41ba-8877-9ce9e4d08133 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:33.432010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6abac-9481-41ba-8877-9ce9e4d08133 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:33.432010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6abac-9481-41ba-8877-9ce9e4d08133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:33.501578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e8b6abac-9481-41ba-8877-9ce9e4d08133 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:33.502811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e8b6abac-9481-41ba-8877-9ce9e4d08133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:33.559836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:33.611244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:33.910171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb340d-79c5-4f84-9e76-8ed121141f69 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:33.912709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-30fb340d-79c5-4f84-9e76-8ed121141f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:34.039009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb340d-79c5-4f84-9e76-8ed121141f69 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:34.099203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:34.130522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:34.131163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:34.131441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:34.131712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:34.133316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:34.252517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:34.254669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfc6a9-a30b-41fd-b4e4-4184558b99df service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:34.278609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 732/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:43.609261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=22 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:44.275551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=66 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:53.994051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4895f-7111-47de-99d4-f22cbd3e37ba None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:53.994645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4895f-7111-47de-99d4-f22cbd3e37ba None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:53.994645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4895f-7111-47de-99d4-f22cbd3e37ba None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:53.995966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 739/1471] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:54.001821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d40ac-d50c-48ec-b07d-9329e2a60094 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:54.002336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d40ac-d50c-48ec-b07d-9329e2a60094 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:54.002336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d40ac-d50c-48ec-b07d-9329e2a60094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:54.075722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0d3d40ac-d50c-48ec-b07d-9329e2a60094 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:54.076835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0d3d40ac-d50c-48ec-b07d-9329e2a60094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:54.189676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 733/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:54.490490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbaab-ed29-4fee-bfd3-4cfdb35585c1 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:54.490812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbaab-ed29-4fee-bfd3-4cfdb35585c1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:54.491074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbaab-ed29-4fee-bfd3-4cfdb35585c1 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:54.492924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 740/1473] 10.222.0.65 () {54 vars in 967 bytes} [Wed Aug 24 09:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:54.497900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6690c-f0bd-47e2-94be-7c1d1af04300 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:54.498187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6690c-f0bd-47e2-94be-7c1d1af04300 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:54.498460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6690c-f0bd-47e2-94be-7c1d1af04300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:54.598219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a1b6690c-f0bd-47e2-94be-7c1d1af04300 None None] MFA Rules not processed for user `c0a103b9b799406fab32d0eaa4965592`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:54.599539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a1b6690c-f0bd-47e2-94be-7c1d1af04300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:54.623660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:54.682412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 734/1474] 10.222.0.65 () {58 vars in 1064 bytes} [Wed Aug 24 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:54.690338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dbaab-ed29-4fee-bfd3-4cfdb35585c1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:54.691925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c10dbaab-ed29-4fee-bfd3-4cfdb35585c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:54.801831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dbaab-ed29-4fee-bfd3-4cfdb35585c1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:54.881416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:54.882032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:54.882310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:54.882578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:54.884234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:54.949440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:55.012043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:55.013503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856208f-cf7a-41f1-8d7a-da060f7d2b06 service glance] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:55.033573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 741/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:57.051608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b65a7-9d11-4fd2-9744-cc0f3d9831dd None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:57.052189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b65a7-9d11-4fd2-9744-cc0f3d9831dd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:57.052189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b65a7-9d11-4fd2-9744-cc0f3d9831dd None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:57.053437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 735/1476] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:57.058939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ab846-aaf2-456a-8912-31d6ba82eded None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:57.059438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ab846-aaf2-456a-8912-31d6ba82eded None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:57.059546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ab846-aaf2-456a-8912-31d6ba82eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:57.130857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-634ab846-aaf2-456a-8912-31d6ba82eded None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:57.132157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-634ab846-aaf2-456a-8912-31d6ba82eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:57.239248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 742/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:57.517338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b65a7-9d11-4fd2-9744-cc0f3d9831dd None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:57.518887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-509b65a7-9d11-4fd2-9744-cc0f3d9831dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:57.668848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b65a7-9d11-4fd2-9744-cc0f3d9831dd None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:57.727484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:57.780160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:57.780704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:57.780984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:57.781254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:57.781905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:57.783944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:54:57.783944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 09:54:57.783944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 09:54:57.785105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f4f4-2b65-451b-b731-30e384e5d5a4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:57.808888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 736/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Aug 24 09:54:57 2022] GET /identity/v3/projects => generated 2553 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:59.745965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce582382-dd33-493b-aff5-df886ac3398d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:59.746508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce582382-dd33-493b-aff5-df886ac3398d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:59.746508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce582382-dd33-493b-aff5-df886ac3398d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:59.747834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 743/1479] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:54:59.754163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f634e6-abd7-42c4-a05d-737eb6b93c6d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:59.754774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f634e6-abd7-42c4-a05d-737eb6b93c6d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:59.754949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f634e6-abd7-42c4-a05d-737eb6b93c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:59.833641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-61f634e6-abd7-42c4-a05d-737eb6b93c6d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:59.834869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-61f634e6-abd7-42c4-a05d-737eb6b93c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:59.942256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 737/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:55:00.239040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce582382-dd33-493b-aff5-df886ac3398d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:00.241078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ce582382-dd33-493b-aff5-df886ac3398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:00.253860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:00.407657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce582382-dd33-493b-aff5-df886ac3398d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:00.502388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:00.539895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:00.540512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:00.540789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:00.541056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:00.542679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:00.642129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:00.643800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33acf32-40aa-4677-a5f8-90709e31d96d service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:00.662115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 744/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:02.807948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8de0f-83bd-49b7-a9a9-d72fefa06c41 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:02.808639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8de0f-83bd-49b7-a9a9-d72fefa06c41 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:02.808639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8de0f-83bd-49b7-a9a9-d72fefa06c41 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:02.809849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 738/1482] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:02.816429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bfd6b-f12c-4fb8-9ec2-fc2b227cab07 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:02.817046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bfd6b-f12c-4fb8-9ec2-fc2b227cab07 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:02.817046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bfd6b-f12c-4fb8-9ec2-fc2b227cab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:02.886966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-867bfd6b-f12c-4fb8-9ec2-fc2b227cab07 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:02.888217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-867bfd6b-f12c-4fb8-9ec2-fc2b227cab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:02.937052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:02.992221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 745/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:55:03.273225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8de0f-83bd-49b7-a9a9-d72fefa06c41 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:03.274761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ecd8de0f-83bd-49b7-a9a9-d72fefa06c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:03.298348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:03.509289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8de0f-83bd-49b7-a9a9-d72fefa06c41 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:03.587179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:03.587789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:03.588064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:03.588324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:03.589908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:03.666620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:03.705070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:03.706524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf2a69-50b2-40cb-970d-f54922fa8ffc service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:03.725235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 739/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:05.694450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469df81-b750-419d-9fe1-52d9a52986bb None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:05.695077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469df81-b750-419d-9fe1-52d9a52986bb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:05.695077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469df81-b750-419d-9fe1-52d9a52986bb None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:05.696355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 746/1485] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:05.702411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd271-c281-47a2-99a1-f10da250290f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:05.702840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd271-c281-47a2-99a1-f10da250290f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:05.702955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd271-c281-47a2-99a1-f10da250290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:05.771853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-6e4dd271-c281-47a2-99a1-f10da250290f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:05.773071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6e4dd271-c281-47a2-99a1-f10da250290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:05.872608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 740/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:55:06.169035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469df81-b750-419d-9fe1-52d9a52986bb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:06.170965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d469df81-b750-419d-9fe1-52d9a52986bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:06.281323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469df81-b750-419d-9fe1-52d9a52986bb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:06.364205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:06.366742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:06.367734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:06.368021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:06.368296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:06.370398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:06.491318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:06.492695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37969637-2777-4a1a-aec7-e1ff938ac1cb service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:06.511579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 747/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:08.556296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97809b73-467b-4a17-8d40-02d656fae30a None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:08.557121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97809b73-467b-4a17-8d40-02d656fae30a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:08.557304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97809b73-467b-4a17-8d40-02d656fae30a None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:08.558865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 741/1488] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:08.565210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dab91-13c3-4b62-a85b-fbb5aaa8e56e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:08.565665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dab91-13c3-4b62-a85b-fbb5aaa8e56e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:08.565763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dab91-13c3-4b62-a85b-fbb5aaa8e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:08.635909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-892dab91-13c3-4b62-a85b-fbb5aaa8e56e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:08.637161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-892dab91-13c3-4b62-a85b-fbb5aaa8e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:08.692329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:08.748207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 748/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:55:09.038749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97809b73-467b-4a17-8d40-02d656fae30a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:09.040336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-97809b73-467b-4a17-8d40-02d656fae30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:09.081975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:09.153697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97809b73-467b-4a17-8d40-02d656fae30a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:09.239986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:09.240564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:09.240870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:09.241101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:09.242688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:09.326796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:09.357355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:09.358794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb4ba6-540f-426f-9017-86c512253950 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:09.376996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 742/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:11.536919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760cfa0-55bc-48eb-aa11-46d9fc01cf07 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:11.537474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760cfa0-55bc-48eb-aa11-46d9fc01cf07 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:11.537474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760cfa0-55bc-48eb-aa11-46d9fc01cf07 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:11.538735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 749/1491] 10.222.0.65 () {54 vars in 927 bytes} [Wed Aug 24 09:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:55:11.544158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d60ec-1b9e-4bf0-a2f3-9c26f3946873 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:11.545189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d60ec-1b9e-4bf0-a2f3-9c26f3946873 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:11.545189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d60ec-1b9e-4bf0-a2f3-9c26f3946873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:11.613896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0c8d60ec-1b9e-4bf0-a2f3-9c26f3946873 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:11.615139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0c8d60ec-1b9e-4bf0-a2f3-9c26f3946873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:11.729645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 743/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Wed Aug 24 09:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:55:12.021678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760cfa0-55bc-48eb-aa11-46d9fc01cf07 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:12.023238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e760cfa0-55bc-48eb-aa11-46d9fc01cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:12.131933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760cfa0-55bc-48eb-aa11-46d9fc01cf07 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:12.210539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:12.211215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:12.211511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:12.211808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:12.213471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:12.224077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:12.331778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:12.333231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38a510-c365-47d7-b3a2-f3e2b7ebd77d service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:12.352834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 750/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:21.727712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=82 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:22.350387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=50 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:25.268021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:25.268610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:25.268610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:25.354995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:25.356308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:25.471600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 744/1494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 09:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:25.489780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:25.490343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:25.490343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:25.570288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:25.571560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:25.679165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 751/1495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 09:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:25.685323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:25.686663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:25.699125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e3456-6e7f-4919-9dc5-63e2821d8bb8 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:25.765676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:25.803827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:25.804446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:25.804748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:25.805015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:25.805675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:56:25.805966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:25.807285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:25.807285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 09:56:25.807285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 09:56:25.808221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:25.821026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 745/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 09:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:56:25.829987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:25.840469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665336-5239-45a6-967c-2cbfdecd8ab3 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:25.916629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:25.953023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:25.953630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:25.953907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:25.954381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:25.956662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:25.962565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:25.962565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 09:56:25.962565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 09:56:25.965340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:26.037746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 752/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 09:56:25 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:56:26.043200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:26.044737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:26.080430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe513671-2933-4072-b774-1db206752c5c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:26.177942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:26.178574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:26.178839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:26.179138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:26.179799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:26.180816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:26.180816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 09:56:26.180816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 09:56:26.182119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:26.235933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 746/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 09:56:26 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:56:26.240427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:26.242034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:26.310412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505271d4-009d-44f9-b0cb-7c13cf975af5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:26.404723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:26.537062 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:26.537750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:26.537956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:26.538224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:26.538917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:26.539980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:26.539980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 09:56:26.539980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 09:56:26.540888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:26.558518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 753/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 09:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:56:26.562830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:26.564397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:26.580284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4838-83e8-4ce6-87ea-507b9b49afa4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:26.617742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:26.696895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:26.698057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:26.698336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:26.698674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:26.699287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:26.700308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:26.700308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 09:56:26.700308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 09:56:26.701215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f3efc-1531-4502-aee8-365337d03c80 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:26.714641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 747/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 09:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:56:26.718994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:26.720591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:26.761583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8d3b-7670-4f56-958b-35b3ca11a74e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:26.873284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:26.873942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:26.874220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:26.874491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] PATH_INFO: `/v3/projects/b05a4da48f0e4aeea91028b551adeed2/users/a8bd2aedea054796bc7d1ef828da359d/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:26.901065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05a4da48f0e4aeea91028b551adeed2, user_id=a8bd2aedea054796bc7d1ef828da359d, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:26.902123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:26.902123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 09:56:26.902123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 09:56:26.904128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6c3f3-12d5-43cd-93c5-b60aa8e64ec5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:26.931025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 754/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 09:56:26 2022] PUT /identity/v3/projects/b05a4da48f0e4aeea91028b551adeed2/users/a8bd2aedea054796bc7d1ef828da359d/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:56:26.944368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461868-3445-4258-8b8d-d0f564c6336c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:26.944729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461868-3445-4258-8b8d-d0f564c6336c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:26.944981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461868-3445-4258-8b8d-d0f564c6336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:27.012600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9d461868-3445-4258-8b8d-d0f564c6336c None None] MFA Rules not processed for user `a8bd2aedea054796bc7d1ef828da359d`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:27.014164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9d461868-3445-4258-8b8d-d0f564c6336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:27.114967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 748/1502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 09:56:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:27.129662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b72ce-7640-4880-96df-2a119bb3f9e8 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:27.130053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b72ce-7640-4880-96df-2a119bb3f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:27.130432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b72ce-7640-4880-96df-2a119bb3f9e8 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:27.132585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 755/1503] 10.222.0.65 () {54 vars in 964 bytes} [Wed Aug 24 09:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:27.138406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ebe00-a912-47a0-b0dc-1a57b0691e12 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:27.138696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ebe00-a912-47a0-b0dc-1a57b0691e12 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:27.139089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ebe00-a912-47a0-b0dc-1a57b0691e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:27.172804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:27.223324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-595ebe00-a912-47a0-b0dc-1a57b0691e12 None None] MFA Rules not processed for user `fc76f59ac1054c18a5e03cc0a18db502`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:27.224643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-595ebe00-a912-47a0-b0dc-1a57b0691e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:27.319591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 749/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Aug 24 09:56:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:56:27.327648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b72ce-7640-4880-96df-2a119bb3f9e8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:27.329164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1c5b72ce-7640-4880-96df-2a119bb3f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:27.389320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:27.460707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b72ce-7640-4880-96df-2a119bb3f9e8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:27.540120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:27.540890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:27.541027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:27.541317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:27.542904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:27.649305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:27.651023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:27.654946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:27.674152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 756/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:27.724310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c84a2a-8782-444f-9e78-f1b466921715 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:27.724769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c84a2a-8782-444f-9e78-f1b466921715 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:27.724867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c84a2a-8782-444f-9e78-f1b466921715 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:27.726148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 750/1506] 10.222.0.65 () {52 vars in 830 bytes} [Wed Aug 24 09:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:56:27.730203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:27.731448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:27.852403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0a4d-be09-4416-a81e-bfb6009eb36b service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:27.949017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:27.949643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:27.949918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:27.950181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] PATH_INFO: `/v3/users/a8bd2aedea054796bc7d1ef828da359d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:27.962572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bd2aedea054796bc7d1ef828da359d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:27.963714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:27.963714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 09:56:27.963714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 09:56:27.964928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:27.974834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:28.040148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bd2aedea054796bc7d1ef828da359d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:28.040739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bd2aedea054796bc7d1ef828da359d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:28.052097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bd2aedea054796bc7d1ef828da359d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:28.052524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bd2aedea054796bc7d1ef828da359d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:28.068664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bd2aedea054796bc7d1ef828da359d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:28.100914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 757/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 09:56:27 2022] DELETE /identity/v3/users/a8bd2aedea054796bc7d1ef828da359d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:56:28.105832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:28.106121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:28.106425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:28.169838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:56:28.171078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:28.251008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:28.264425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 751/1508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 09:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:28.274930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:28.276383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:28.390763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336df03-8c42-4a7e-ad09-8b75db91cbb4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:28.453444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:28.474921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:28.475566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:28.475844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:28.476115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:28.477713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:28.596865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:28.598386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605e36-b862-494b-acfd-f13e3ea01eca service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:28.618186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 758/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:28.988115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:28.989444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:29.002116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278736f-c027-4f2a-8029-840cebab2547 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:29.113225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:29.113861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:29.114135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:29.114399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] PATH_INFO: `/v3/projects/b05a4da48f0e4aeea91028b551adeed2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:29.124894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05a4da48f0e4aeea91028b551adeed2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:29.125924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:56:29.125924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 09:56:29.125924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 09:56:29.127176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:29.205247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05a4da48f0e4aeea91028b551adeed2', 'request_id': 'req-3a5af8eb-0217-4666-9b61-4e91a592a885'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:29.220103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05a4da48f0e4aeea91028b551adeed2', 'request_id': 'req-3a5af8eb-0217-4666-9b61-4e91a592a885'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:29.226776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05a4da48f0e4aeea91028b551adeed2', 'request_id': 'req-3a5af8eb-0217-4666-9b61-4e91a592a885'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:29.256244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] The token cache is being invalidate because project b05a4da48f0e4aeea91028b551adeed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:56:29.256530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:29.256962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3a5af8eb-0217-4666-9b61-4e91a592a885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:56:29.258394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 752/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 09:56:28 2022] DELETE /identity/v3/projects/b05a4da48f0e4aeea91028b551adeed2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:56:38.615910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=62 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:39.253977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:12.968222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2728-cc00-4470-9d27-c43291bf5072 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:12.968835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2728-cc00-4470-9d27-c43291bf5072 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:12.968835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2728-cc00-4470-9d27-c43291bf5072 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:12.970285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:12.975723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc0e2-f761-42ab-80f2-bfb5ef2f498b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:12.976129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc0e2-f761-42ab-80f2-bfb5ef2f498b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:12.976271 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dc0e2-f761-42ab-80f2-bfb5ef2f498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:13.071639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-012dc0e2-f761-42ab-80f2-bfb5ef2f498b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:13.072867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-012dc0e2-f761-42ab-80f2-bfb5ef2f498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:13.189597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:13.358456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2728-cc00-4470-9d27-c43291bf5072 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:13.361923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c9fb2728-cc00-4470-9d27-c43291bf5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:13.505487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2728-cc00-4470-9d27-c43291bf5072 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:13.511735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7badf0-ef93-49fb-8f16-8deb522fd74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:13.514001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7badf0-ef93-49fb-8f16-8deb522fd74d service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:13.514285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7badf0-ef93-49fb-8f16-8deb522fd74d service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:13.514557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7badf0-ef93-49fb-8f16-8deb522fd74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:13.523225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7badf0-ef93-49fb-8f16-8deb522fd74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:13.524825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7badf0-ef93-49fb-8f16-8deb522fd74d service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:13.537225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 760/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:14.362104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d03d-92a8-4834-8dee-ab7fc6ed81fe None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:14.362698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d03d-92a8-4834-8dee-ab7fc6ed81fe None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:14.362698 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d03d-92a8-4834-8dee-ab7fc6ed81fe None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:14.364018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:14.373124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa265b-226f-4dc8-9b74-34762b5c03e8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:14.374021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa265b-226f-4dc8-9b74-34762b5c03e8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:14.374021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa265b-226f-4dc8-9b74-34762b5c03e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:14.405831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c5fa265b-226f-4dc8-9b74-34762b5c03e8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:14.407082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c5fa265b-226f-4dc8-9b74-34762b5c03e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:14.417638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:14.590415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63d03d-92a8-4834-8dee-ab7fc6ed81fe None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:14.607647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63d03d-92a8-4834-8dee-ab7fc6ed81fe None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:14.616214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ccc3a-f05b-49d5-a013-4666b271a776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:14.617210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ccc3a-f05b-49d5-a013-4666b271a776 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:14.617678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ccc3a-f05b-49d5-a013-4666b271a776 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:14.618172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ccc3a-f05b-49d5-a013-4666b271a776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:14.628322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ccc3a-f05b-49d5-a013-4666b271a776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:14.629920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ccc3a-f05b-49d5-a013-4666b271a776 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:14.639758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 755/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:15.379308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993768-859f-4872-b098-595981f7905d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:15.379893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993768-859f-4872-b098-595981f7905d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:15.379893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993768-859f-4872-b098-595981f7905d None None] PATH_INFO: `/v3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:15.381771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 762/1517] 10.222.0.83 () {54 vars in 925 bytes} [Wed Aug 24 09:58:15 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:58:15.389296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49f0c3-7458-4413-b415-771804fcb1b1 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:15.389767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49f0c3-7458-4413-b415-771804fcb1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:15.389864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49f0c3-7458-4413-b415-771804fcb1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:15.452925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-df49f0c3-7458-4413-b415-771804fcb1b1 None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:15.454125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-df49f0c3-7458-4413-b415-771804fcb1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:15.472296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:15.534643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 756/1518] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Aug 24 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:24.398731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=56 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:25.271641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f66661-7318-4170-a8fd-bfb9f32312e3 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.271853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f66661-7318-4170-a8fd-bfb9f32312e3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.272095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f66661-7318-4170-a8fd-bfb9f32312e3 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.273462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 763/1519] 10.222.0.65 () {54 vars in 961 bytes} [Wed Aug 24 09:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:25.278952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91728b-1d69-4863-8843-9b2baf3d31e6 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.279504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91728b-1d69-4863-8843-9b2baf3d31e6 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.279504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91728b-1d69-4863-8843-9b2baf3d31e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.301888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2c91728b-1d69-4863-8843-9b2baf3d31e6 None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:25.303195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2c91728b-1d69-4863-8843-9b2baf3d31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:25.312987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 757/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Aug 24 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:25.321171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f66661-7318-4170-a8fd-bfb9f32312e3 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:25.336509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f66661-7318-4170-a8fd-bfb9f32312e3 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:25.342874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90d85b-0ef6-4192-a0db-860a4ed2e1c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:25.343537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90d85b-0ef6-4192-a0db-860a4ed2e1c0 service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.343820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90d85b-0ef6-4192-a0db-860a4ed2e1c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.344096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90d85b-0ef6-4192-a0db-860a4ed2e1c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.352912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90d85b-0ef6-4192-a0db-860a4ed2e1c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:25.354523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90d85b-0ef6-4192-a0db-860a4ed2e1c0 service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:25.364466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 764/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:25.874337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0cec1-cdae-4e0e-b51d-609a7ed8205a None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.874971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0cec1-cdae-4e0e-b51d-609a7ed8205a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.875558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0cec1-cdae-4e0e-b51d-609a7ed8205a None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.877913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:25.883087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517b44-127a-49a1-8986-2c9c5a3c6730 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:25.883623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517b44-127a-49a1-8986-2c9c5a3c6730 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:25.883623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517b44-127a-49a1-8986-2c9c5a3c6730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:25.903832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-49517b44-127a-49a1-8986-2c9c5a3c6730 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:25.904999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-49517b44-127a-49a1-8986-2c9c5a3c6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:25.913378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:26.082529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0cec1-cdae-4e0e-b51d-609a7ed8205a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:26.099483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0cec1-cdae-4e0e-b51d-609a7ed8205a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:26.105410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304977f6-5bd6-40f0-8e8e-50c613acb4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:26.106231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304977f6-5bd6-40f0-8e8e-50c613acb4f3 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:26.106685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304977f6-5bd6-40f0-8e8e-50c613acb4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:26.106970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304977f6-5bd6-40f0-8e8e-50c613acb4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:26.115225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304977f6-5bd6-40f0-8e8e-50c613acb4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:26.116821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304977f6-5bd6-40f0-8e8e-50c613acb4f3 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:26.128400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 759/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:58:26.958175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871b27-7823-4ba2-9949-07e154b594ed None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:26.959109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871b27-7823-4ba2-9949-07e154b594ed None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:26.959109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871b27-7823-4ba2-9949-07e154b594ed None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:26.961225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:26.970031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e168-d30f-4f14-8a88-8bc9e5fc7eb8 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:26.970808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e168-d30f-4f14-8a88-8bc9e5fc7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:26.970982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e168-d30f-4f14-8a88-8bc9e5fc7eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:26.996419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-ea46e168-d30f-4f14-8a88-8bc9e5fc7eb8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:26.997948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ea46e168-d30f-4f14-8a88-8bc9e5fc7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:27.007386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:27.169350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871b27-7823-4ba2-9949-07e154b594ed None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:27.186732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871b27-7823-4ba2-9949-07e154b594ed None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:27.192567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade69210-888b-4b32-8ed2-dc5637a21773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:27.193188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69210-888b-4b32-8ed2-dc5637a21773 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:27.193787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69210-888b-4b32-8ed2-dc5637a21773 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:27.194056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69210-888b-4b32-8ed2-dc5637a21773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:27.202320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade69210-888b-4b32-8ed2-dc5637a21773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:27.203944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade69210-888b-4b32-8ed2-dc5637a21773 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:27.213556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 767/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:31.051947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f90df-dcf9-4bed-a2df-ac42b84b0b51 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:31.052918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f90df-dcf9-4bed-a2df-ac42b84b0b51 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:31.052918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f90df-dcf9-4bed-a2df-ac42b84b0b51 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:31.055033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:31.060710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea264dd-301b-4e65-a8ea-a0f00dbf16d7 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:31.061172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea264dd-301b-4e65-a8ea-a0f00dbf16d7 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:31.061307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea264dd-301b-4e65-a8ea-a0f00dbf16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:31.083870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9ea264dd-301b-4e65-a8ea-a0f00dbf16d7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:31.085071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9ea264dd-301b-4e65-a8ea-a0f00dbf16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:31.093284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:31.373831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f90df-dcf9-4bed-a2df-ac42b84b0b51 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:31.376757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-045f90df-dcf9-4bed-a2df-ac42b84b0b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:31.463459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f90df-dcf9-4bed-a2df-ac42b84b0b51 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:31.467938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fce2d6-01b0-4c25-8c22-3f3640ed7198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:31.468553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fce2d6-01b0-4c25-8c22-3f3640ed7198 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:31.468955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fce2d6-01b0-4c25-8c22-3f3640ed7198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:31.469433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fce2d6-01b0-4c25-8c22-3f3640ed7198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:31.483616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fce2d6-01b0-4c25-8c22-3f3640ed7198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:31.485077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fce2d6-01b0-4c25-8c22-3f3640ed7198 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:31.495245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 762/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:33.416293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6856f91-7073-4201-967f-4a6ea789169d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:33.416889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6856f91-7073-4201-967f-4a6ea789169d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:33.416889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6856f91-7073-4201-967f-4a6ea789169d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:33.418193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:33.423871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a30b-2108-4d4a-b187-53153afe020a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:33.424330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a30b-2108-4d4a-b187-53153afe020a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:33.424532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a30b-2108-4d4a-b187-53153afe020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:33.445929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4221a30b-2108-4d4a-b187-53153afe020a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:33.447158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4221a30b-2108-4d4a-b187-53153afe020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:33.456742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:33.741837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6856f91-7073-4201-967f-4a6ea789169d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:33.761576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6856f91-7073-4201-967f-4a6ea789169d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:33.766275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502f23c-c9f6-4a25-ac01-397e1b4b4242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:33.766876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f23c-c9f6-4a25-ac01-397e1b4b4242 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:33.767173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f23c-c9f6-4a25-ac01-397e1b4b4242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:33.767444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502f23c-c9f6-4a25-ac01-397e1b4b4242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:33.777089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502f23c-c9f6-4a25-ac01-397e1b4b4242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:33.778489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502f23c-c9f6-4a25-ac01-397e1b4b4242 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:33.788343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 770/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:37.253079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e84af-2e9e-4ba0-98de-1c05a612ec75 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.253606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e84af-2e9e-4ba0-98de-1c05a612ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.253734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e84af-2e9e-4ba0-98de-1c05a612ec75 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.255845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:58:37.264150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3cea1-bfed-454a-b948-7983c94988d9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.264606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3cea1-bfed-454a-b948-7983c94988d9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.264717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3cea1-bfed-454a-b948-7983c94988d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.284515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1ec3cea1-bfed-454a-b948-7983c94988d9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:37.285721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1ec3cea1-bfed-454a-b948-7983c94988d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:37.294580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:37.841269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e84af-2e9e-4ba0-98de-1c05a612ec75 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:37.843408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-451e84af-2e9e-4ba0-98de-1c05a612ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:37.913899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:37.937129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e84af-2e9e-4ba0-98de-1c05a612ec75 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:37.941183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa440fa6-9807-454d-9f67-07ebc0d90c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:37.941796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440fa6-9807-454d-9f67-07ebc0d90c6c service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:37.942055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440fa6-9807-454d-9f67-07ebc0d90c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:37.942326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa440fa6-9807-454d-9f67-07ebc0d90c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:37.956133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440fa6-9807-454d-9f67-07ebc0d90c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:37.958312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa440fa6-9807-454d-9f67-07ebc0d90c6c service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:37.970542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 765/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:39.947115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437efe-2e8c-4660-b037-8d7203bebbbc None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:39.947807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437efe-2e8c-4660-b037-8d7203bebbbc None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:39.947908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437efe-2e8c-4660-b037-8d7203bebbbc None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:39.949932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:58:39.955804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49da3f-6b89-407a-a4e2-445936ef2cf4 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:39.956279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49da3f-6b89-407a-a4e2-445936ef2cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:39.956370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49da3f-6b89-407a-a4e2-445936ef2cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:39.978057 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9d49da3f-6b89-407a-a4e2-445936ef2cf4 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:58:39.979321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9d49da3f-6b89-407a-a4e2-445936ef2cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:39.988401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:58:40.554129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437efe-2e8c-4660-b037-8d7203bebbbc None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:40.556170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3e437efe-2e8c-4660-b037-8d7203bebbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:40.574005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437efe-2e8c-4660-b037-8d7203bebbbc None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:40.579191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb0f23-00cd-46dd-afc6-b63443a07f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:40.579904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb0f23-00cd-46dd-afc6-b63443a07f8c service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:40.580294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb0f23-00cd-46dd-afc6-b63443a07f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:40.580660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb0f23-00cd-46dd-afc6-b63443a07f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:40.593222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb0f23-00cd-46dd-afc6-b63443a07f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:40.594682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb0f23-00cd-46dd-afc6-b63443a07f8c service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:40.604832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 773/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 09:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:58:49.972859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=11 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:50.600466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=33 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:08.577947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.579065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.579065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.611018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:08.613437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:08.623883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 767/1540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:08.633030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.634077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.634567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.665815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:08.667195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:08.678197 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 774/1541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:08.683313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:08.701646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3cda9-cc21-42b1-9d37-1cd62bc4c4e3 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:08.715833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:08.716473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.716772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.717212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.717881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:08.718280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:08.720071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794aa15-0a36-4ee7-949a-d7723bacfc68 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:08.737839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 768/1542] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:08.746305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:08.757559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871362b-f888-4bb9-bc90-005821d43bd3 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:08.762366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:08.762992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.763293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.763706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.764517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:08.766433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:08.788270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005be0-db1a-4908-b5b9-c4d800707f8b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.788633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005be0-db1a-4908-b5b9-c4d800707f8b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.788835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005be0-db1a-4908-b5b9-c4d800707f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.825238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-01005be0-db1a-4908-b5b9-c4d800707f8b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:08.826481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-01005be0-db1a-4908-b5b9-c4d800707f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:08.830465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 775/1543] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:08.836741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:08.943322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 769/1544] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:08.943834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d717de7-38e9-472c-a21d-c4081ace376e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:08.944628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.944920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.945516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.951035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:08.951750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.952026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.952294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:08.952985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:08.954018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:00:08.954018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 10:00:08.954018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 10:00:08.955246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddd1a0-13cd-45f7-8972-f20b13e271bd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:08.987524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:08.988902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:08.989489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 776/1545] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:08.990951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538959-f210-4b60-9b28-ab91b06c6901 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:08.991342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538959-f210-4b60-9b28-ab91b06c6901 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:08.991677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538959-f210-4b60-9b28-ab91b06c6901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.010454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 770/1546] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:09.011346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.022405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ec538959-f210-4b60-9b28-ab91b06c6901 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.023640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ec538959-f210-4b60-9b28-ab91b06c6901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.035413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 777/1547] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.037383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f631-329f-4e94-85e2-7689b7fb2deb None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.039932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.040332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.040607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.051029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab015-ebd9-4bdc-8259-5dabb9214d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.051685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab015-ebd9-4bdc-8259-5dabb9214d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.052063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab015-ebd9-4bdc-8259-5dabb9214d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.052320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab015-ebd9-4bdc-8259-5dabb9214d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.052990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab015-ebd9-4bdc-8259-5dabb9214d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.054868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab015-ebd9-4bdc-8259-5dabb9214d51 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.076456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.077674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.078726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 771/1548] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:09.079776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.080066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.080349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.092012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 778/1549] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.092798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.111030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19191c4f-b3bc-4949-9224-862c5ea4ddfd None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.115067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.116278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.122574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.123284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.123562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.123832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.124493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.124793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.126943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:00:09.126943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 10:00:09.126943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 10:00:09.133506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.138982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 772/1550] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.140110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.148605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 779/1551] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.150415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498a365-fffc-46d9-98bf-81e0c08a0a67 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.152209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.158390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee43314-3f24-43f7-8d82-bd40552b9794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.159291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43314-3f24-43f7-8d82-bd40552b9794 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.159570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43314-3f24-43f7-8d82-bd40552b9794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.160583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee43314-3f24-43f7-8d82-bd40552b9794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.161239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee43314-3f24-43f7-8d82-bd40552b9794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.162864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee43314-3f24-43f7-8d82-bd40552b9794 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.164097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8223d-e263-4636-8502-dd4683568a9d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.168973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.169686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.169963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.170230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.170876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.171213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.172832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a703df-fe8b-4fbb-9dd2-a9b90b89b3f2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.174765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 773/1552] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:09.176235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbdd86-1e49-49cd-b48b-32796e45e8c5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.176517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbdd86-1e49-49cd-b48b-32796e45e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.176891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbdd86-1e49-49cd-b48b-32796e45e8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.194570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 780/1553] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.195917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09c9e9-6652-4e94-8eb3-cdd1390cc40c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.196202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09c9e9-6652-4e94-8eb3-cdd1390cc40c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.196473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09c9e9-6652-4e94-8eb3-cdd1390cc40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.197366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-96cbdd86-1e49-49cd-b48b-32796e45e8c5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.198865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-96cbdd86-1e49-49cd-b48b-32796e45e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.208724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 774/1554] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.209843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.210131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.210409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.224612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0c09c9e9-6652-4e94-8eb3-cdd1390cc40c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.225425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0c09c9e9-6652-4e94-8eb3-cdd1390cc40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.231477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.232631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.233374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 781/1555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.234550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.234834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.235137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.242394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 775/1556] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.243328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.255764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b2eb3-761a-4495-9716-ee9d34656853 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.256386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.257590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.260516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.261166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.261433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.261711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.262338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.263400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:00:09.263400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 10:00:09.263400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 10:00:09.264613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09abf-d0fa-4267-a737-c7fcb5cd07c2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.265719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 782/1557] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.266457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.275817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c0a8b-f586-406f-82b3-4bc6ccf64540 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.280506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.281121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.281398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.281668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] PATH_INFO: `/v3/projects/98466e8254344d6aa5dd3787caabf5d0/users/8576deb9a96d458cba3e374b36a233b5/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.296563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 776/1558] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.296563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dee7e-8ac4-49da-ac13-7fbffffadbe5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.296563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dee7e-8ac4-49da-ac13-7fbffffadbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.296563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dee7e-8ac4-49da-ac13-7fbffffadbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.297033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98466e8254344d6aa5dd3787caabf5d0, user_id=8576deb9a96d458cba3e374b36a233b5, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.299909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.313963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 783/1559] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:09 2022] PUT /identity/v3/projects/98466e8254344d6aa5dd3787caabf5d0/users/8576deb9a96d458cba3e374b36a233b5/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:09.314838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.318821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cf9dee7e-8ac4-49da-ac13-7fbffffadbe5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.320071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cf9dee7e-8ac4-49da-ac13-7fbffffadbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.356060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:09.380031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab849ff-c582-4a86-8b8f-e7955ffbe99c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.382005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 777/1560] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.383141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfebac-2522-4040-a7c5-27d383dedd53 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.383463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfebac-2522-4040-a7c5-27d383dedd53 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.383736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfebac-2522-4040-a7c5-27d383dedd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.385841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729c0a8-4dd0-4633-9650-88f1520af2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.386524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c0a8-4dd0-4633-9650-88f1520af2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.386789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c0a8-4dd0-4633-9650-88f1520af2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.387079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729c0a8-4dd0-4633-9650-88f1520af2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.387753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729c0a8-4dd0-4633-9650-88f1520af2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.389684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729c0a8-4dd0-4633-9650-88f1520af2e3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.403724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fdbfebac-2522-4040-a7c5-27d383dedd53 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.404913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fdbfebac-2522-4040-a7c5-27d383dedd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.413575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 778/1561] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.418489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.418765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 784/1562] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.419018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.419315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.420163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.420450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.420723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.428179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:09.442720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.443954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.446743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.447963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.507235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 779/1563] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.509001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 785/1564] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.509826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.511714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.518836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b680148-058c-4bcc-8ca9-f566f71805d1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.520875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4a02-2bb5-42f9-b311-10307c8e8859 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.525393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b935-1089-4089-b5d8-8a41c2d15b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.525533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.526005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.526280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.526405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b935-1089-4089-b5d8-8a41c2d15b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.526543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.526811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b935-1089-4089-b5d8-8a41c2d15b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.527217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.527317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b935-1089-4089-b5d8-8a41c2d15b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.527518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.528119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b935-1089-4089-b5d8-8a41c2d15b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.529117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d858d0-bb20-4184-8c4f-41efbcc7e000 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.530577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b935-1089-4089-b5d8-8a41c2d15b2b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.543676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 780/1565] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.545619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.546151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.546561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.557897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 786/1566] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.560417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.561006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.561150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.567567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.568758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.577475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 781/1567] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.578557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.581740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:09.582719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.588655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c49d89-73d7-471d-b498-b9ebcab2efb7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.591311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 787/1568] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:09.593724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.594362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.594729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.595341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.595579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.595995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.596297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.598154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.605092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c1848-e9eb-4e3f-997b-fcda1523a2be None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.609679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.610215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.610488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.610759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.610874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 782/1569] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.611411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.611832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.613443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.623404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b37c15-5133-41bc-b494-abd03fdacd12 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.628326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.629123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.629507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.629799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.630434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.630753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.632392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.636001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 788/1570] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.637447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.645180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 783/1571] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.646082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.649114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592145-4e6e-4e7b-ad31-354ddfca12a4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.654896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.655531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.655788 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.656080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.656217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51f94-1726-4799-bd6b-24605714d168 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.656726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.657024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.658675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.661582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.662189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.662496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.662770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.663411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.665329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.671510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 789/1572] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.676471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.687439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e393e5d-e339-43d4-9682-138a63b462a9 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.692297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.692895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.693171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.693462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.694109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.695745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.695937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 784/1573] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.696827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.698489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:09.709280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 790/1574] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:09.710113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.719746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805e90-98af-4dd8-af0d-bb1aa0674e9b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.758318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a476d-b6b7-4ea9-a128-7c967c688f58 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.762105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.762723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.763003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.763304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.771434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:09.779463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.780087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.780562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.780836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.781493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:09.781825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.783485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.795470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 791/1575] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:09.799940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.810677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e636-6d71-48ad-97f6-a818ad134017 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.812216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:09.817444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.818070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.818359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.818631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.819421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.821522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.827654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.830227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.839824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 785/1576] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:09.840677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.853439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7cb48-5224-43ee-960c-3325ffced8c1 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.858928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.859587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.859933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.860151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.860788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.862439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 792/1577] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.862568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.864179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.875566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 786/1578] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:09.876411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:09.889112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0018-1983-44fa-89f7-9aff200bc61d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.943452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c1e5a-2ffe-48b3-a424-b87927a27e04 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:09.949248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.949939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.950260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.950854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.951581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.953540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.964770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:09.965503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:09.965963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:09.966300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:09.966938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:09.969037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:09.986927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 793/1579] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:09.986927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.006290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 787/1580] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.008594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.061379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c8248-2370-4e58-92c6-9072eae60c30 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.089539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ff399-10d2-44e9-9f58-0017c3f4e73c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.094862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.095555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.096066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.096258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.097084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.099432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.111235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 788/1581] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.111896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.123220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e71e4-330b-4959-afe4-6fbb99d32c0c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.129377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.130008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.130463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.130780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.131535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.133554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.149217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.150159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.150593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.151024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.151801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.153758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.163979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:10.172027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 789/1582] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.176455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.187273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 794/1583] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:09 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.188235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.211687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b68acf-765b-43d9-9f6a-06570de06324 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.228099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:10.258563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ef3f2-8de7-4d59-a005-d5cb8ac07833 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.265733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.266743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.267594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.267594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.268311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.271761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.282563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.283723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.283988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.284428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.285604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.288453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.304280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 790/1584] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.304280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.304579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 795/1585] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.305868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.312813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930ea7-0ac2-4505-babd-d6e18464f1b2 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.317806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.318364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75727540-4a63-4eb4-b5d4-695c21845044 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.318503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.318702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.318964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.319633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.321581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.324659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.325345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.325696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.326033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.326724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.329155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.345573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 791/1586] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.346406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.358234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 796/1587] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.358914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf306-4b51-4e04-bdf9-f1ee01352745 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.362387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.364178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.365791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.366081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.366361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] PATH_INFO: `/v3/projects/4132cc2b40bf416880f4f52c1baa0783/users/b63914ce814a43078a1c177cff9a89fb/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.373076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cf46-c822-4f44-9c03-240c8108179c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.378095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.378781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.379158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.379608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.380351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.382405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.383687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4132cc2b40bf416880f4f52c1baa0783, user_id=b63914ce814a43078a1c177cff9a89fb, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.384680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:00:10.384680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 10:00:10.384680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 10:00:10.387091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.407137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 792/1588] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:10 2022] PUT /identity/v3/projects/4132cc2b40bf416880f4f52c1baa0783/users/b63914ce814a43078a1c177cff9a89fb/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:10.408824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.414476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 797/1589] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:10.414476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.424491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0c812-3373-440f-8fc0-a2914aeddc85 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.484197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead7b9f-c765-4011-bad5-c39939898c11 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.490070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.490867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.491337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.491757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.492681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.494726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.507150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.507893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 793/1590] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.508021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.508142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.508419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.509004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.509208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.510863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.521323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056af718-72c5-40d5-a400-abe1bbead304 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.522494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 798/1591] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.526301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.528506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823f258-8c94-4b8d-9db0-0a7e631f01bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.529365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f258-8c94-4b8d-9db0-0a7e631f01bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.529562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f258-8c94-4b8d-9db0-0a7e631f01bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.529843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f258-8c94-4b8d-9db0-0a7e631f01bd admin admin] PATH_INFO: `/v3/projects/1272d3f95b374cf48ddbac0e796ffea0/users/7b478a587aa7484898b16e6fd5564253/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.545131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428f54a-dace-41d2-b4ec-f17e8042f1be admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.550519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.552309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.552596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.552870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.553526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.554211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823f258-8c94-4b8d-9db0-0a7e631f01bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1272d3f95b374cf48ddbac0e796ffea0, user_id=7b478a587aa7484898b16e6fd5564253, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.555322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.557381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823f258-8c94-4b8d-9db0-0a7e631f01bd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.571689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 799/1592] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.575227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.583549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 794/1593] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:10 2022] PUT /identity/v3/projects/1272d3f95b374cf48ddbac0e796ffea0/users/7b478a587aa7484898b16e6fd5564253/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:10.585904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.586758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.587029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.589701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c2bd6-9143-479f-bb1e-f5a2d6dec552 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.615894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:10.617102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:10.633658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:10.676626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.677342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.678067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.678067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.678435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.680500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.687077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:10.699887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 800/1594] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.701180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.710672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 795/1595] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:10.711597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.714413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2690bb-2e1f-4713-809c-a22a06b64b88 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.720375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.721369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.722020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.722706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.722886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554caf2f-ac9c-428c-9329-a6c496779a91 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.724076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.726226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.730411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.731084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.731360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.731636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.732299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.734045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.742379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 801/1596] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.743825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.748788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 796/1597] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.751326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.755862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160bed2-2757-4de1-ac51-18b22f8b24de admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.763721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38c67f-2641-4081-8fac-fb3663c6266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.764368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38c67f-2641-4081-8fac-fb3663c6266c admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.764800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38c67f-2641-4081-8fac-fb3663c6266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.765081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38c67f-2641-4081-8fac-fb3663c6266c admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.766323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2755b-a0aa-43ee-800b-ac08b26d3397 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.766714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38c67f-2641-4081-8fac-fb3663c6266c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.768537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38c67f-2641-4081-8fac-fb3663c6266c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.771205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.772078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.772785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.773130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.774576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.775598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.782138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 802/1598] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.787419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 797/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.788429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.792104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.792672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.792799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.800257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce7707-e195-4873-a90a-5e9f901c4d11 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.811788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.813291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.813576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.813856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.814562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.816299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.818107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:10.819490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:10.829531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 803/1600] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:10.831124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 798/1601] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.832214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.833034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.844894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed88edc-7c18-49bd-a919-35d2a5bbacfb admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.851540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.852266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.852545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.852818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.853516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.855720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.876215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 799/1602] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:10.877188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:10.900921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16048-109a-42b1-a886-2e7e38a06d8f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.909297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.910403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.910903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.911412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] PATH_INFO: `/v3/projects/aba1b22e54104a8b8dd8bf06bb319dbe/users/9579f6a06b1743039bb5c3db8e88e460/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.940796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39381cc5-51a0-4511-a564-f8301e775475 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:10.942728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba1b22e54104a8b8dd8bf06bb319dbe, user_id=9579f6a06b1743039bb5c3db8e88e460, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.947763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:10.948389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.949923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:10.950382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:10.951533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:10.972043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:10.974234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:10.977907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 800/1603] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:10 2022] PUT /identity/v3/projects/aba1b22e54104a8b8dd8bf06bb319dbe/users/9579f6a06b1743039bb5c3db8e88e460/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:10.977907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:11.015402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 804/1604] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:11.016473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:11.041081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bc2b-ae1b-4289-a92f-d5fd2949fe64 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:11.108204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61501e52-c413-477e-a1db-3346b14dbce5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:11.118306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:11.119195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.119949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.120434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] PATH_INFO: `/v3/projects/18ece732bd8e4baba091c3290d2ffaed/users/a3111f69a0eb43dd9086f346e076c1d0/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.166356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ece732bd8e4baba091c3290d2ffaed, user_id=a3111f69a0eb43dd9086f346e076c1d0, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:11.190253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:11.198384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:11.198989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.201125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.201543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] PATH_INFO: `/v3/projects/629c125bf59140299a02c08085448c94/users/421b69943ac14d5c9cf84eadfcbdc3d1/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.241236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 801/1605] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:10 2022] PUT /identity/v3/projects/18ece732bd8e4baba091c3290d2ffaed/users/a3111f69a0eb43dd9086f346e076c1d0/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:11.245986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629c125bf59140299a02c08085448c94, user_id=421b69943ac14d5c9cf84eadfcbdc3d1, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:11.257965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:11.258148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:11.290853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 805/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:11 2022] PUT /identity/v3/projects/629c125bf59140299a02c08085448c94/users/421b69943ac14d5c9cf84eadfcbdc3d1/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:11.292396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:11.425605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:11.466901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbcf2b-8dfc-413b-8489-c40393a3ebe3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:11.470440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329d50e-0033-4b11-be28-ae43156bf5f4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:11.475015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:11.475678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.475960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.476303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.490449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:11.556582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:11.557763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01768d96-698c-4921-a188-4a1fef01928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:11.558063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:11.558509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768d96-698c-4921-a188-4a1fef01928b admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.558796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768d96-698c-4921-a188-4a1fef01928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.559107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768d96-698c-4921-a188-4a1fef01928b admin admin] PATH_INFO: `/v3/projects/81bb6322cc754ccd8e70a0f185e7fd30/users/cf76e4d108e140508be72bd1afd5ca2f/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.570958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 806/1607] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:11.571873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:11.580249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01768d96-698c-4921-a188-4a1fef01928b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bb6322cc754ccd8e70a0f185e7fd30, user_id=cf76e4d108e140508be72bd1afd5ca2f, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:11.581957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c78aef-f718-4643-b478-b6001fe9f53f service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:11.583663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01768d96-698c-4921-a188-4a1fef01928b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:11.595321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6a13-0b5c-491e-ae7f-c0e9c71a53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:11.595969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a13-0b5c-491e-ae7f-c0e9c71a53f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.596286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a13-0b5c-491e-ae7f-c0e9c71a53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.596571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a13-0b5c-491e-ae7f-c0e9c71a53f0 admin admin] PATH_INFO: `/v3/projects/c43f70b192db46419922af390e40ad3d/users/6b203e7c32524906b9fd7b09ee9ca054/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.612880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 802/1608] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:11 2022] PUT /identity/v3/projects/81bb6322cc754ccd8e70a0f185e7fd30/users/cf76e4d108e140508be72bd1afd5ca2f/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:11.612880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6d93-b73a-4d86-91ff-b108e7edc91c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.612880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6d93-b73a-4d86-91ff-b108e7edc91c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.612880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6d93-b73a-4d86-91ff-b108e7edc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.623031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6a13-0b5c-491e-ae7f-c0e9c71a53f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43f70b192db46419922af390e40ad3d, user_id=6b203e7c32524906b9fd7b09ee9ca054, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:11.626187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6a13-0b5c-491e-ae7f-c0e9c71a53f0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:11.651798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 807/1609] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:11 2022] PUT /identity/v3/projects/c43f70b192db46419922af390e40ad3d/users/6b203e7c32524906b9fd7b09ee9ca054/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:11.654489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c572be2-7452-47f7-9f19-2c989aa6ff0e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.655025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c572be2-7452-47f7-9f19-2c989aa6ff0e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.655486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c572be2-7452-47f7-9f19-2c989aa6ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.690816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-94ad6d93-b73a-4d86-91ff-b108e7edc91c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:11.694069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-94ad6d93-b73a-4d86-91ff-b108e7edc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:11.704427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9c572be2-7452-47f7-9f19-2c989aa6ff0e None None] MFA Rules not processed for user `a3111f69a0eb43dd9086f346e076c1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:11.706462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9c572be2-7452-47f7-9f19-2c989aa6ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:11.874166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 803/1610] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:11.877848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.878675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.879410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.881043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 808/1611] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:11.882450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5fff9-ecec-4f1f-b473-f924b96331ea None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.882743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5fff9-ecec-4f1f-b473-f924b96331ea None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.883203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5fff9-ecec-4f1f-b473-f924b96331ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:11.916549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-abb5fff9-ecec-4f1f-b473-f924b96331ea None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:11.917948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-abb5fff9-ecec-4f1f-b473-f924b96331ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:11.924402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] MFA Rules not processed for user `421b69943ac14d5c9cf84eadfcbdc3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:11.926491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:11.959724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 809/1612] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:11.961052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:11.961339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:11.961615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.018471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] MFA Rules not processed for user `6b203e7c32524906b9fd7b09ee9ca054`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:12.020843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:12.032061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 804/1613] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:12.032961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.066225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:12.088312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee0f53-75b8-4f2f-8ba9-1b4e0b17fbc8 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:12.102940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:12.104366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.105797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.106087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.106743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:12.115318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:12.144194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 810/1614] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:12.147427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.181897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 805/1615] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:12 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:12.185033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.217464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:12.265012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd169a8e-efa0-40f9-97dd-5e6727670658 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:12.304340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a79e2-22e3-4b02-9268-30db7d74a4db admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:12.317338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b3b4e-8825-4ef8-a0ef-dd83b84807a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:12.318116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b3b4e-8825-4ef8-a0ef-dd83b84807a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.318991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b3b4e-8825-4ef8-a0ef-dd83b84807a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.318991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b3b4e-8825-4ef8-a0ef-dd83b84807a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.365227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3590e-26a8-45b8-aba2-5c3e932f5509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:12.367877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3590e-26a8-45b8-aba2-5c3e932f5509 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.368643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3590e-26a8-45b8-aba2-5c3e932f5509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.369196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3590e-26a8-45b8-aba2-5c3e932f5509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.423870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b3b4e-8825-4ef8-a0ef-dd83b84807a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:12.426045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b3b4e-8825-4ef8-a0ef-dd83b84807a3 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:12.447624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 806/1616] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:12.451338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238e37-c064-4af1-b045-add1b406d702 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.451714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238e37-c064-4af1-b045-add1b406d702 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.460133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238e37-c064-4af1-b045-add1b406d702 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.466786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 807/1617] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 10:00:12 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:00:12.468254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dcbcc-ce23-4e9c-9326-e66bfd6f3b12 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.468553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dcbcc-ce23-4e9c-9326-e66bfd6f3b12 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.472639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dcbcc-ce23-4e9c-9326-e66bfd6f3b12 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.475114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 808/1618] 10.222.0.65 () {54 vars in 962 bytes} [Wed Aug 24 10:00:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:00:12.477054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dcbcc-ce23-4e9c-9326-e66bfd6f3b12 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.499700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dcbcc-ce23-4e9c-9326-e66bfd6f3b12 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:12.506861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db807160-d971-4a61-8739-524100737c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:12.508572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db807160-d971-4a61-8739-524100737c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.509520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db807160-d971-4a61-8739-524100737c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.509806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db807160-d971-4a61-8739-524100737c6c admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.510651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db807160-d971-4a61-8739-524100737c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:12.512982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db807160-d971-4a61-8739-524100737c6c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:12.579230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 809/1619] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:12 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:12.582749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.584189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.585042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.608565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3590e-26a8-45b8-aba2-5c3e932f5509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:12.610999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3590e-26a8-45b8-aba2-5c3e932f5509 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:12.639374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 811/1620] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:12.641848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.642159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.642417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.694742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:12.697776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:12.697957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:12.703792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:12.789080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:12.867381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 810/1621] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 10:00:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:12.877235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 812/1622] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Aug 24 10:00:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:12.881897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.884855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.906393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d26e0-809d-40bb-a625-55d34f93bf9b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:12.907725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafa32a-a020-4945-b629-29bbc2908d1c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:12.915398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:12.916631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.917199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.917652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.919062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:12.922390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:12.923735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:12.924495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:12.924823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:12.925101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:12.954913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 811/1623] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:12.956746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:12.987165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1219317-78ec-445b-b55b-f3fe15701dce admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:13.018285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:13.026669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.027949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.028715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.041487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:13.151422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:13.155517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:13.182259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 813/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:13.189613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:13.212667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0521ae1-2e1e-4f3b-8d63-7326d3edcb21 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:13.224200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:13.228345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:13.241870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:13.245596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.246172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.247365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] PATH_INFO: `/v3/projects/1476c60f64a44bf2bcb27584586c4518/users/14e823dc3c3f4eee957805a45ab68247/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.255817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 812/1625] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:13.313247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1476c60f64a44bf2bcb27584586c4518, user_id=14e823dc3c3f4eee957805a45ab68247, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:13.324235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:13.367211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 814/1626] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:13 2022] PUT /identity/v3/projects/1476c60f64a44bf2bcb27584586c4518/users/14e823dc3c3f4eee957805a45ab68247/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:13.371041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:13.386376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d11db6-4265-4b6b-9f9b-9a08aae4ecf4 service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:13.586741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d982-d138-43ca-a861-7406f71f9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:13.587570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d982-d138-43ca-a861-7406f71f9e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.587852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d982-d138-43ca-a861-7406f71f9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.588123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d982-d138-43ca-a861-7406f71f9e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.588775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d982-d138-43ca-a861-7406f71f9e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:13.590831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d982-d138-43ca-a861-7406f71f9e92 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:13.614879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 813/1627] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:13.619692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:13.635494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ddc31-ed7b-4df1-9260-255d5b82c6de admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:13.652335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8ab7-ac46-4a37-a63f-19953f63926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:13.653102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8ab7-ac46-4a37-a63f-19953f63926d admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.653838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8ab7-ac46-4a37-a63f-19953f63926d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.654117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8ab7-ac46-4a37-a63f-19953f63926d admin admin] PATH_INFO: `/v3/projects/1476c60f64a44bf2bcb27584586c4518/users/14e823dc3c3f4eee957805a45ab68247/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.673957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8ab7-ac46-4a37-a63f-19953f63926d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1476c60f64a44bf2bcb27584586c4518, user_id=14e823dc3c3f4eee957805a45ab68247, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:13.681459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c8ab7-ac46-4a37-a63f-19953f63926d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:13.713953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 815/1628] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:13 2022] PUT /identity/v3/projects/1476c60f64a44bf2bcb27584586c4518/users/14e823dc3c3f4eee957805a45ab68247/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:13.725161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.725512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.725783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.777996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb91e0f-12d2-4141-95a4-265eed066fd2 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.777996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb91e0f-12d2-4141-95a4-265eed066fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.777996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb91e0f-12d2-4141-95a4-265eed066fd2 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.779100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 816/1629] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 10:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:00:13.789836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb349-00ff-4ecf-8bd3-78401984caaa None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.790408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb349-00ff-4ecf-8bd3-78401984caaa None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.790507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb349-00ff-4ecf-8bd3-78401984caaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.796509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] MFA Rules not processed for user `14e823dc3c3f4eee957805a45ab68247`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:13.797718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:13.845550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-741eb349-00ff-4ecf-8bd3-78401984caaa None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:13.851779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-741eb349-00ff-4ecf-8bd3-78401984caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:13.953461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 817/1630] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:13.954988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03886-7a45-4898-a5de-f94041d0316c None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.955410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03886-7a45-4898-a5de-f94041d0316c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.955903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03886-7a45-4898-a5de-f94041d0316c None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.963951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 818/1631] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 10:00:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:00:13.965719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:13.966159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:13.966668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:13.995633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:13.997087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:14.002437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 814/1632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:14.003394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:14.032453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 819/1633] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:00:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:14.033529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:14.051071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:14.105418 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:14.133270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78a3c4-393a-470c-9f86-ad6763fd1aac None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:14.143092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:14.143888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:14.144444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:14.144871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:14.166928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc744-a22a-44ef-894c-cb797e5a1a17 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:14.167796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:14.169860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:14.171667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:14.172294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:14.172643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:14.172831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:14.183751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 820/1634] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:14.200224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:14.201703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:14.227898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 815/1635] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:14.281481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:14.297629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15cae2-c7cf-4dbd-9af0-14e88f6de3a4 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:14.310800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6962e-0255-45d8-b1f4-495b17cb40da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:14.311466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6962e-0255-45d8-b1f4-495b17cb40da service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:14.311742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6962e-0255-45d8-b1f4-495b17cb40da service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:14.312010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6962e-0255-45d8-b1f4-495b17cb40da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:14.344463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6962e-0255-45d8-b1f4-495b17cb40da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:14.346061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6962e-0255-45d8-b1f4-495b17cb40da service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:14.362225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 821/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:14.803762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:14.943484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a559d0-aad6-4b8d-9287-d1c044911723 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:14.954165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:14.955911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:14.957547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:14.958316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] PATH_INFO: `/v3/users/421b69943ac14d5c9cf84eadfcbdc3d1` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:14.962769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=421b69943ac14d5c9cf84eadfcbdc3d1)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:14.965423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: WARNING py.warnings [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:00:14.965423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: warnings.warn(msg) Aug 24 10:00:14.965423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: Aug 24 10:00:14.969227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:15.168759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421b69943ac14d5c9cf84eadfcbdc3d1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.169672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421b69943ac14d5c9cf84eadfcbdc3d1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.171670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421b69943ac14d5c9cf84eadfcbdc3d1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.196100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421b69943ac14d5c9cf84eadfcbdc3d1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.230844 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421b69943ac14d5c9cf84eadfcbdc3d1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.370865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 816/1637] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:14 2022] DELETE /identity/v3/users/421b69943ac14d5c9cf84eadfcbdc3d1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:15.371002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:15.371002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:15.371002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:15.395561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:15.398151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:15.418124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:15.420388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:15.590098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:15.594196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 822/1638] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:15.627791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b2ce0-3ada-46ac-a6bb-565ebcf1b86a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:15.644046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:15.644870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:15.645250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:15.645857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] PATH_INFO: `/v3/users/a3111f69a0eb43dd9086f346e076c1d0` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:15.646805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3111f69a0eb43dd9086f346e076c1d0)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:15.648875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:15.705637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:15.709495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:15.757630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3111f69a0eb43dd9086f346e076c1d0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.760066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3111f69a0eb43dd9086f346e076c1d0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.761744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3111f69a0eb43dd9086f346e076c1d0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.777171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3111f69a0eb43dd9086f346e076c1d0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.793957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f516bea8-9bb1-42a4-996b-af47f8308d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3111f69a0eb43dd9086f346e076c1d0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:15.840454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 817/1639] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:15 2022] DELETE /identity/v3/users/a3111f69a0eb43dd9086f346e076c1d0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:15.845944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:15.846581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9d415-2f93-4ebf-9088-c018f28e06ef None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:15.846889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:15.847484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:15.891989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:15.893622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:15.948127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:15.948810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:15.949453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:15.949724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:15.951596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:15.968979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:16.058526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 818/1640] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:16.060114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:16.061872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:16.096864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 823/1641] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:16.131362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:16.133932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:16.157394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce38f3-22c7-4e6f-aedc-8473345f1dd7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:16.167750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:16.168544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:16.168931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:16.169305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:16.197023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:16.202532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:16.225159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 819/1642] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:18.101821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:18.104171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:18.131078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55a86-83b0-43ec-8936-48d3192a6b6c service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:18.159382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:18.160156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:18.160606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:18.161031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] PATH_INFO: `/v3/projects/629c125bf59140299a02c08085448c94` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:18.163303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629c125bf59140299a02c08085448c94)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:18.164661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: WARNING py.warnings [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:00:18.164661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: warnings.warn(msg) Aug 24 10:00:18.164661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: Aug 24 10:00:18.166693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:18.306430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:18.311175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:18.366245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed3d6c-9bce-4e00-9391-17176feb8fdf service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:18.381631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629c125bf59140299a02c08085448c94', 'request_id': 'req-ed875b6a-23a8-446a-b88a-871d494886a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.399288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629c125bf59140299a02c08085448c94', 'request_id': 'req-ed875b6a-23a8-446a-b88a-871d494886a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.437248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629c125bf59140299a02c08085448c94', 'request_id': 'req-ed875b6a-23a8-446a-b88a-871d494886a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.477835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] The token cache is being invalidate because project 629c125bf59140299a02c08085448c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:18.478085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.481982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.485448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 824/1643] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:18 2022] DELETE /identity/v3/projects/629c125bf59140299a02c08085448c94 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:18.490133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:18.496470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:18.501599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:18.514463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:18.517394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:18.517772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:18.518065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] PATH_INFO: `/v3/users/6b203e7c32524906b9fd7b09ee9ca054` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:18.521596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b203e7c32524906b9fd7b09ee9ca054)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:18.528648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:18.668828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed875b6a-23a8-446a-b88a-871d494886a1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:18.692746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:18.693842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:18.693842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:18.694006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] PATH_INFO: `/v3/projects/18ece732bd8e4baba091c3290d2ffaed` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:18.695611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ece732bd8e4baba091c3290d2ffaed)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:18.697581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:18.710366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b203e7c32524906b9fd7b09ee9ca054'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.712305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b203e7c32524906b9fd7b09ee9ca054'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.716644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b203e7c32524906b9fd7b09ee9ca054'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.733065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b203e7c32524906b9fd7b09ee9ca054'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.758513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-43d6e0e7-b061-4d14-8d75-175eac0beafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b203e7c32524906b9fd7b09ee9ca054'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.803826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:18.827041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ece732bd8e4baba091c3290d2ffaed', 'request_id': 'req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.838425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 820/1644] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:18 2022] DELETE /identity/v3/users/6b203e7c32524906b9fd7b09ee9ca054 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:18.840514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:18.841963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:18.842789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:18.843345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ece732bd8e4baba091c3290d2ffaed', 'request_id': 'req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.864209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ece732bd8e4baba091c3290d2ffaed', 'request_id': 'req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.888213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] The token cache is being invalidate because project 18ece732bd8e4baba091c3290d2ffaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:18.888586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.894570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:18.896206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:18.897539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c28eaee3-3fa7-48f1-8dee-f35051e3b01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:18.899367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 825/1645] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:18 2022] DELETE /identity/v3/projects/18ece732bd8e4baba091c3290d2ffaed => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:18.900672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcb612-5511-43f1-9cc4-e3c748e2d8fd None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:18.900961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcb612-5511-43f1-9cc4-e3c748e2d8fd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:18.901240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcb612-5511-43f1-9cc4-e3c748e2d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:18.938869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-46dcb612-5511-43f1-9cc4-e3c748e2d8fd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:18.940158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-46dcb612-5511-43f1-9cc4-e3c748e2d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.086981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 821/1646] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:19.088463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:19.090415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.143550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc01d36-976c-475d-8265-68cf67e91991 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:19.165708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:19.166825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 826/1647] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:19.168207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:19.168486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:19.168756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] PATH_INFO: `/v3/users/14e823dc3c3f4eee957805a45ab68247` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:19.174831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2d39-a9f9-4300-9566-eccd40b227ed None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:19.175110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2d39-a9f9-4300-9566-eccd40b227ed None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:19.175334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2d39-a9f9-4300-9566-eccd40b227ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:19.177793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e823dc3c3f4eee957805a45ab68247)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:19.188417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:19.241125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-3ffd2d39-a9f9-4300-9566-eccd40b227ed None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:19.244074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3ffd2d39-a9f9-4300-9566-eccd40b227ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.262771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 827/1648] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:19.264586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:19.265102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:19.266315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:19.300552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e823dc3c3f4eee957805a45ab68247'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:19.303616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e823dc3c3f4eee957805a45ab68247'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:19.304543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e823dc3c3f4eee957805a45ab68247'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:19.337416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e823dc3c3f4eee957805a45ab68247'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:19.356754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] MFA Rules not processed for user `8576deb9a96d458cba3e374b36a233b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:19.360282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.360649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e823dc3c3f4eee957805a45ab68247'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:19.381050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:19.406713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 822/1649] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:19 2022] DELETE /identity/v3/users/14e823dc3c3f4eee957805a45ab68247 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:19.410853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:19.413162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.532280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 828/1650] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:19.532280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:19.538372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.555685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379bd5a-936e-41dc-b756-c4265e4cb0e1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:19.569728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:19.570341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:19.570751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:19.571033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:19.573849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.580200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c5ca8-fdda-4288-a39c-c7befb03f553 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:19.696086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:19.723477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:19.724258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:19.724536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:19.724808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:19.725574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:19.735662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:19.737359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:19.750762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:19.755867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:19.764459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 829/1651] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:19.765434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:19.767668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:19.776206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 823/1652] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:19.777624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:19.796399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410201d-eeaf-4166-a54b-06983dabe9dc service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:19.806060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:19.807249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:19.807809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:19.808877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:19.809924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:19.816388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:19.876907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 824/1653] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:19 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:19.881791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:19.962641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327ed93-db2e-4f3d-a996-2a01c7686dcd admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.026248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c161-e2dc-4db9-b25f-4e5d2857072b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.039775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.044876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.045462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.046356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.047262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.054471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.105897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.106482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.106758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.107094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.131627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 825/1654] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:19 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:20.136137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.175854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fec7a-a2b5-4260-9eb5-25df7a30bf89 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.188805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.189723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.191198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.191549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.193397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.199830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.202772 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:20.229588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.235210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.243398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 826/1655] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:20.247754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.262642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 830/1656] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:20.272240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2dc0f-47e6-4f8f-99ef-0bdc33e8be98 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.283221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.284074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.284351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.284674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.285494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.291317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.300508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.302038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:20.310751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 827/1657] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:20.315632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.335221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4651-40bd-4d8f-8129-98b41e77da35 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.346097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.346881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.347029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50c8d-f128-4a6c-a64f-595f1f6b35b0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.347510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.347741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] PATH_INFO: `/v3/projects/1476c60f64a44bf2bcb27584586c4518` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.355160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1476c60f64a44bf2bcb27584586c4518)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.357163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.364089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0580f-e616-4c33-ac0e-c45ad93c5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.365835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0580f-e616-4c33-ac0e-c45ad93c5e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.366174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0580f-e616-4c33-ac0e-c45ad93c5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.366454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0580f-e616-4c33-ac0e-c45ad93c5e5a admin admin] PATH_INFO: `/v3/projects/3cce86283c7446e48d0069a04b50fbfb/users/2d19c386e7744e078c02d3c4c477fa42/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.376813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:20.397961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0580f-e616-4c33-ac0e-c45ad93c5e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cce86283c7446e48d0069a04b50fbfb, user_id=2d19c386e7744e078c02d3c4c477fa42, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.400889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0580f-e616-4c33-ac0e-c45ad93c5e5a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.437456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 828/1658] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:20 2022] PUT /identity/v3/projects/3cce86283c7446e48d0069a04b50fbfb/users/2d19c386e7744e078c02d3c4c477fa42/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:20.444151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.444503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.444882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.478345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:20.478544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1476c60f64a44bf2bcb27584586c4518', 'request_id': 'req-877d100f-7564-4a94-8655-a6e1a8435d71'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:20.479783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:20.498093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1476c60f64a44bf2bcb27584586c4518', 'request_id': 'req-877d100f-7564-4a94-8655-a6e1a8435d71'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:20.512859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1476c60f64a44bf2bcb27584586c4518', 'request_id': 'req-877d100f-7564-4a94-8655-a6e1a8435d71'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:20.544035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] The token cache is being invalidate because project 1476c60f64a44bf2bcb27584586c4518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:20.544154 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:20.549978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-877d100f-7564-4a94-8655-a6e1a8435d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:20.555199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 831/1659] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:20 2022] DELETE /identity/v3/projects/1476c60f64a44bf2bcb27584586c4518 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:00:20.556819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaf72-293d-4648-bc1d-d8dcd18eb008 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.557112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaf72-293d-4648-bc1d-d8dcd18eb008 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.557394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aaf72-293d-4648-bc1d-d8dcd18eb008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.596689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-376aaf72-293d-4648-bc1d-d8dcd18eb008 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:20.598137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-376aaf72-293d-4648-bc1d-d8dcd18eb008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:20.646770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 829/1660] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:20.710519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.712100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:20.764844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 832/1661] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:20.774847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.779380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.779583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.858590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:20.861213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:20.896223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 833/1662] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:20.897239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.901002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea2ac-88e8-468e-90a3-395bfa9fedc3 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.908839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.909513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.909816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.910087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.917261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793c2ef-5c8b-46ae-8990-e231886778c8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.929967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.931206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.931206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.931206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.931867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:20.932220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.933721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.935428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.942132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:20.961121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 834/1663] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:20.961860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:20.963751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 830/1664] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:20.973870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a3572-6521-4b83-8af4-555c75383ffd admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:20.980161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:20.981913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:20.982417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:20.982861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:20.984396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:20.986446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:21.029858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 835/1665] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:20 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:21.034033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:21.045733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b113a-826f-47c4-8e35-6a643598ed52 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:21.186867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:21.187983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:21.187983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:21.187983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:21.188555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:21.191177 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:21.225720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:21.248206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 831/1666] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:21 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:21.252165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:21.274470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee167d4-ba50-4b9f-8b68-12dbee342940 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:21.289192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:21.289843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:21.290125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:21.290396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:21.291121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:21.292816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:21.314742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 836/1667] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:21.321239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:21.332239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f1d8c-42da-4667-83af-517b6ba02170 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:21.350269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6443-d007-47a7-af2b-f5f5e6b36178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:21.350986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6443-d007-47a7-af2b-f5f5e6b36178 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:21.351266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6443-d007-47a7-af2b-f5f5e6b36178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:21.351573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6443-d007-47a7-af2b-f5f5e6b36178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:21.352242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd6443-d007-47a7-af2b-f5f5e6b36178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:21.353994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd6443-d007-47a7-af2b-f5f5e6b36178 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:21.391037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 832/1668] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:21.395330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:21.414949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf1e14-27ef-4f9f-afb2-bd33e4ca744e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:21.431989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:21.432657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:21.432937 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:21.433216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] PATH_INFO: `/v3/projects/03518800bdbc44f98aab270af07d2244/users/dca4d518295c411699e038c3a9cc0699/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:21.456552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03518800bdbc44f98aab270af07d2244, user_id=dca4d518295c411699e038c3a9cc0699, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:21.459474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:21.505782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 837/1669] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:21 2022] PUT /identity/v3/projects/03518800bdbc44f98aab270af07d2244/users/dca4d518295c411699e038c3a9cc0699/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:21.507744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:21.508037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:21.508314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:21.562398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] MFA Rules not processed for user `dca4d518295c411699e038c3a9cc0699`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:21.566316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:21.695572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:21.709264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 833/1670] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:21.726730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:21.800894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b9173-4b06-4a53-bee1-cfea0fa55ffb admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:21.806888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:21.807861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:21.808343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:21.808696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:21.809852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:21.812201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:21.870264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:21.872748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 838/1671] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:21 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:00:21.890137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d48d-b9c5-4df4-bb87-6e03bb33a96b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:22.015864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:22.016505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.016789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.017488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.019964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:22.024590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:22.077752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 834/1672] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:21 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:22.083923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:22.101370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8298-bbd2-4f20-9a76-c0af806d44d7 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:22.113821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:22.115018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.116095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.116617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.118266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:22.121139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:22.140852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 839/1673] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:22.142027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:22.155637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a254f-ee57-4500-b865-750498879202 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:22.179416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:22.180388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.180672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.180950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] PATH_INFO: `/v3/projects/3f08f23331bd43cfb9774de98818525c/users/8115e62ecc374a0ba46b7425d5dfcabf/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.201736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f08f23331bd43cfb9774de98818525c, user_id=8115e62ecc374a0ba46b7425d5dfcabf, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:22.207502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:22.230484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 835/1674] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:22 2022] PUT /identity/v3/projects/3f08f23331bd43cfb9774de98818525c/users/8115e62ecc374a0ba46b7425d5dfcabf/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:22.232875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:22.248975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e6c9-70dc-4b2a-b2f2-b7e07bc88f30 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:22.308157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:22.311330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:22.373521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:22.374216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.374501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.375957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.377217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:22.381383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:22.414854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 840/1675] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:22.416936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:22.420799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:22.438556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8e0b1-382f-491f-932e-b44085fac3b1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:22.452739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc72db2-7064-413d-9318-2c0b17ab70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:22.453545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72db2-7064-413d-9318-2c0b17ab70ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.453723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72db2-7064-413d-9318-2c0b17ab70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.455165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72db2-7064-413d-9318-2c0b17ab70ed admin admin] PATH_INFO: `/v3/projects/3f08f23331bd43cfb9774de98818525c/users/8115e62ecc374a0ba46b7425d5dfcabf/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.461578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc72db2-7064-413d-9318-2c0b17ab70ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f08f23331bd43cfb9774de98818525c, user_id=8115e62ecc374a0ba46b7425d5dfcabf, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:22.468944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc72db2-7064-413d-9318-2c0b17ab70ed admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:22.485433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c35689-3efa-4c99-b77a-de557aefa934 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:22.519607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 841/1676] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:22 2022] PUT /identity/v3/projects/3f08f23331bd43cfb9774de98818525c/users/8115e62ecc374a0ba46b7425d5dfcabf/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:22.530011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.530302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.530581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.614157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] MFA Rules not processed for user `8115e62ecc374a0ba46b7425d5dfcabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:22.615451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:22.620015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:22.630287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.630659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.631004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] PATH_INFO: `/v3/projects/c43f70b192db46419922af390e40ad3d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.632651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43f70b192db46419922af390e40ad3d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:22.635012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:22.748829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43f70b192db46419922af390e40ad3d', 'request_id': 'req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:22.759261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43f70b192db46419922af390e40ad3d', 'request_id': 'req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:22.771889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43f70b192db46419922af390e40ad3d', 'request_id': 'req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:22.803795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] The token cache is being invalidate because project c43f70b192db46419922af390e40ad3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:22.804118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:22.804849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-cd7f0125-bd02-49a9-b8b9-9cb5f7a07799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:22.807181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 836/1677] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:22 2022] DELETE /identity/v3/projects/c43f70b192db46419922af390e40ad3d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:22.815781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d949a8-a95a-42c3-ace3-4e3a7155da7c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.816078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d949a8-a95a-42c3-ace3-4e3a7155da7c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.816363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d949a8-a95a-42c3-ace3-4e3a7155da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:22.865929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-02d949a8-a95a-42c3-ace3-4e3a7155da7c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:22.868160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-02d949a8-a95a-42c3-ace3-4e3a7155da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:22.900567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 842/1678] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:22.911632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:22.915569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:22.935110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:22.988129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 837/1679] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:22.994022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:22.994507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:22.995007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.029447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:23.031014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:23.063337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 838/1680] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:23.064811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.079195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ff3fe-0118-4eb8-bb42-225a97cf0112 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.086242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.087300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.087783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.088254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.089821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:23.090509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.091810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1586-5d7d-428e-81ac-b3d67dd19f49 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.092856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.097018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:23.119563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 839/1681] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:23.126594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.140900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca5821-84c8-4530-a721-6cbeda4d2b91 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.153802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.153802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.153802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.153802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.154253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.154970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.217035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 840/1682] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:23 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:23.223010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.255555 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.256362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.256649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.256922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.407464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070dcba-6ae4-46ba-9b78-729f7c6f6fe1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.419821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.421575 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.422556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.430322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.430531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.434511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.434668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.441621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.467118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 843/1683] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:23.513178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 841/1684] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:23 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:23.514850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.518190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.523440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:23.531724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cbc5-6e79-46f7-b291-f347676b5e42 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.550791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.551719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.552136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.552556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.553364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.557106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.559557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae155956-8acb-47b4-a9cc-b594b70f251d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.573577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.574914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.579372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.579940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] PATH_INFO: `/v3/users/dca4d518295c411699e038c3a9cc0699` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.585649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 844/1685] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:23.590300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.590459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca4d518295c411699e038c3a9cc0699)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.592966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.612182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3171a0a-6669-4f9b-a92f-deb7092c2ca8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.634651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.635630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.636259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.636668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.637526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.644823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.672031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 845/1686] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:23.676654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.682965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca4d518295c411699e038c3a9cc0699'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:23.683832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca4d518295c411699e038c3a9cc0699'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:23.684542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca4d518295c411699e038c3a9cc0699'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:23.698453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca4d518295c411699e038c3a9cc0699'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:23.701232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c07f8-9ab1-46ed-bb1a-0cf5540ae5ab admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:23.709782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-600dc042-432b-4b2a-a119-1e030f44e0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca4d518295c411699e038c3a9cc0699'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:23.712625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f617bd9-b1c2-4bce-8d1d-3d9abc0cea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:23.713467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f617bd9-b1c2-4bce-8d1d-3d9abc0cea70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.713888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f617bd9-b1c2-4bce-8d1d-3d9abc0cea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.714764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f617bd9-b1c2-4bce-8d1d-3d9abc0cea70 admin admin] PATH_INFO: `/v3/projects/a0e6341184b44699bd135388b1eec9b1/users/498f519146ba4b8ea7d1eddf4aecc28d/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.735940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 842/1687] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:23 2022] DELETE /identity/v3/users/dca4d518295c411699e038c3a9cc0699 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:23.740923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.741540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.742054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.754368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f617bd9-b1c2-4bce-8d1d-3d9abc0cea70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e6341184b44699bd135388b1eec9b1, user_id=498f519146ba4b8ea7d1eddf4aecc28d, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:23.758135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f617bd9-b1c2-4bce-8d1d-3d9abc0cea70 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:23.767156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:23.770013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:23.789777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 846/1688] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:23 2022] PUT /identity/v3/projects/a0e6341184b44699bd135388b1eec9b1/users/498f519146ba4b8ea7d1eddf4aecc28d/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:23.800289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:23.800809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:23.801285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:23.823420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:23.859694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] MFA Rules not processed for user `498f519146ba4b8ea7d1eddf4aecc28d`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:23.864589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:23.878472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 843/1689] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:23.896694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:23.974177 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:23.976387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:24.068272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 847/1690] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:24.073411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:24.075664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:24.122640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929b21-a741-4003-b1d8-1031748073c4 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:24.257543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5ce7-af89-4a1e-8018-fa45b14039e4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:24.271818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:24.272392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:24.272769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:24.273093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:24.273866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:24.275853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:24.278044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:24.278807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:24.279215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:24.279718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:24.318857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:24.324187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:24.340996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 844/1691] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:24.342791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 848/1692] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:24 2022] POST /identity/v3/projects => generated 379 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:24.346114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:24.366154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559f79f-c60b-46fd-a21e-bb9fe0a7d45e service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:24.533508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:24.534343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:24.534733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:24.535157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:24.536101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:24.540245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:24.587550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 845/1693] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:24 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:24.591960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:24.609372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262263d7-9b34-4314-b6fc-e53958697be6 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:24.620495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:24.622080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:24.622388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:24.622938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:24.623674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:24.627330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:24.649292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 849/1694] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:24.653458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:24.671745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dc842-cbbe-4181-8eb7-03e076cf260a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:24.683006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:24.683006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:24.683980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:24.683980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] PATH_INFO: `/v3/projects/de358812bbda40e9b59566194b1689e7/users/6e3d923b7c7f423e8de3a67c887aa034/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:24.717565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de358812bbda40e9b59566194b1689e7, user_id=6e3d923b7c7f423e8de3a67c887aa034, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:24.722800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:24.752514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:24.769570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 846/1695] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:24 2022] PUT /identity/v3/projects/de358812bbda40e9b59566194b1689e7/users/6e3d923b7c7f423e8de3a67c887aa034/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:24.775550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:24.800344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f0016-2482-412b-be3a-f6e33b4ba84f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:24.939358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39a5d9-29a2-450b-abe3-2ae47b8c1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:24.940859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39a5d9-29a2-450b-abe3-2ae47b8c1ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:24.941491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39a5d9-29a2-450b-abe3-2ae47b8c1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:24.942050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39a5d9-29a2-450b-abe3-2ae47b8c1ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:24.949038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39a5d9-29a2-450b-abe3-2ae47b8c1ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:24.954458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39a5d9-29a2-450b-abe3-2ae47b8c1ea3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:24.971111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 850/1696] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:24.977084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:25.023298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fcd80-26cb-4b53-8202-8016bcbd635d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:25.029288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:25.030582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:25.031283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:25.031747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] PATH_INFO: `/v3/projects/de358812bbda40e9b59566194b1689e7/users/6e3d923b7c7f423e8de3a67c887aa034/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:25.043159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de358812bbda40e9b59566194b1689e7, user_id=6e3d923b7c7f423e8de3a67c887aa034, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:25.046124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:25.066142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 847/1697] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:24 2022] PUT /identity/v3/projects/de358812bbda40e9b59566194b1689e7/users/6e3d923b7c7f423e8de3a67c887aa034/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:25.081490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:25.083560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:25.084555 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:25.125360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] MFA Rules not processed for user `6e3d923b7c7f423e8de3a67c887aa034`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:25.126626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:25.138553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:25.274321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 851/1698] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:25.289401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:25.291614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:25.371908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:25.376603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:25.406800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca2133-415a-44fa-a1aa-0adefceea790 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:25.410658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:25.411401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:25.411923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:25.412199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:25.422949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:25.424771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:25.451104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 848/1699] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:25.528116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974cb3c-0e83-4acf-87a9-31187bc0a779 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:25.562111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:25.563224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:25.564785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:25.565261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:25.565632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] PATH_INFO: `/v3/projects/03518800bdbc44f98aab270af07d2244` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:25.567233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03518800bdbc44f98aab270af07d2244)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:25.570062 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:25.573429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b0aeb-efff-4e01-9044-f34e26f1b8b6 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:25.590528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aff8ce-754a-408b-9009-29e05a5dc88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:25.592899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aff8ce-754a-408b-9009-29e05a5dc88d service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:25.593117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aff8ce-754a-408b-9009-29e05a5dc88d service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:25.593399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aff8ce-754a-408b-9009-29e05a5dc88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:25.687416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03518800bdbc44f98aab270af07d2244', 'request_id': 'req-9539bf64-08e7-4e0b-843e-685b892b69a7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:25.714259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03518800bdbc44f98aab270af07d2244', 'request_id': 'req-9539bf64-08e7-4e0b-843e-685b892b69a7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:25.733836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03518800bdbc44f98aab270af07d2244', 'request_id': 'req-9539bf64-08e7-4e0b-843e-685b892b69a7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:25.741228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aff8ce-754a-408b-9009-29e05a5dc88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:25.744808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aff8ce-754a-408b-9009-29e05a5dc88d service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:25.765801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] The token cache is being invalidate because project 03518800bdbc44f98aab270af07d2244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:25.765801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:25.767839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:25.771974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 852/1700] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:25 2022] DELETE /identity/v3/projects/03518800bdbc44f98aab270af07d2244 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:25.776008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:25.780203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 849/1701] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:25.781085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:25.894342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:25.977618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bf64-08e7-4e0b-843e-685b892b69a7 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:25.985930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:25.987769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:25.988231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:25.988803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] PATH_INFO: `/v3/users/8115e62ecc374a0ba46b7425d5dfcabf` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:25.991380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8115e62ecc374a0ba46b7425d5dfcabf)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:25.995746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:26.142586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8115e62ecc374a0ba46b7425d5dfcabf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:26.144642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8115e62ecc374a0ba46b7425d5dfcabf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:26.165405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8115e62ecc374a0ba46b7425d5dfcabf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:26.166115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8115e62ecc374a0ba46b7425d5dfcabf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:26.178720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-498440c3-8a50-4716-920e-bc4b2801ce22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8115e62ecc374a0ba46b7425d5dfcabf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:26.219399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 853/1702] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:25 2022] DELETE /identity/v3/users/8115e62ecc374a0ba46b7425d5dfcabf => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:26.532875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621212f-826d-4d49-9d1c-74b08aceb079 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:26.533087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621212f-826d-4d49-9d1c-74b08aceb079 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:26.533339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621212f-826d-4d49-9d1c-74b08aceb079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:26.593999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2621212f-826d-4d49-9d1c-74b08aceb079 None None] MFA Rules not processed for user `7b478a587aa7484898b16e6fd5564253`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:26.597018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2621212f-826d-4d49-9d1c-74b08aceb079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:26.615981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:26.616547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:26.616825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:26.653061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] MFA Rules not processed for user `8576deb9a96d458cba3e374b36a233b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:26.659876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:26.839164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 850/1703] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:26.839164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:26.839164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:26.839164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:26.859129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 854/1704] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:26.861175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:26.863309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:26.896453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] MFA Rules not processed for user `2d19c386e7744e078c02d3c4c477fa42`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:26.897567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:26.909430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:27.041002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 851/1705] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:26 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:27.045108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.048136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:27.064621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:27.106815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fac8e5-10e2-40a9-89a6-72ef4ed3cbb1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.120272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.126304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.126856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.127365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.139399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.141933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.160700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 855/1706] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:27.176954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd300d7-51e5-4482-bd96-3ff2ed12d0d2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.181932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.182734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.183013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.183367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.184006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.185945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.258216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 852/1707] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:27 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:27.261946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.277081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008be1-64b8-473d-bd76-b6536858ef56 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.439716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.440660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.442747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.443332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.447404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.453837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.531551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 856/1708] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:27 2022] POST /identity/v3/users => generated 308 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:27.531738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.543454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ad42-8dd5-4c78-bc3e-0c51d07d8e33 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.560655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.561589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.561589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.561859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.562471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.565780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.591299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 853/1709] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:27.592848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.608209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8a60-e18e-489d-9338-17e6c65b04ce admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.617979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.618711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.618936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.619235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] PATH_INFO: `/v3/projects/b41e11af95924026805e3a235cf985b9/users/538b324be9bc4e8f8e38bf55ff6075a4/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.652152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41e11af95924026805e3a235cf985b9, user_id=538b324be9bc4e8f8e38bf55ff6075a4, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.654923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.688862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 857/1710] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:27 2022] PUT /identity/v3/projects/b41e11af95924026805e3a235cf985b9/users/538b324be9bc4e8f8e38bf55ff6075a4/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:27.690874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.718958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be97e6-3be0-44ed-a3bc-f91c6ed7d576 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.873750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.875737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:27.885412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.887888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.888172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.890811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.892273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.897594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.899116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede965b-0695-4c72-8d83-dd6f89043b8b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.912603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.913284 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.913551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.913816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] PATH_INFO: `/v3/projects/3f08f23331bd43cfb9774de98818525c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.915012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f08f23331bd43cfb9774de98818525c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:27.917041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:27.936730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 854/1711] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:27.944078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:27.968636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0f0f-fe05-4b43-adc6-b15497ec8cb5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:27.985371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113b7ab-4a04-4a4d-a242-38ef96cdae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:27.985967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113b7ab-4a04-4a4d-a242-38ef96cdae6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:27.986246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113b7ab-4a04-4a4d-a242-38ef96cdae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:27.986521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113b7ab-4a04-4a4d-a242-38ef96cdae6d admin admin] PATH_INFO: `/v3/projects/b41e11af95924026805e3a235cf985b9/users/538b324be9bc4e8f8e38bf55ff6075a4/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:27.997501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113b7ab-4a04-4a4d-a242-38ef96cdae6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41e11af95924026805e3a235cf985b9, user_id=538b324be9bc4e8f8e38bf55ff6075a4, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:28.001820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113b7ab-4a04-4a4d-a242-38ef96cdae6d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:28.039973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 855/1712] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:27 2022] PUT /identity/v3/projects/b41e11af95924026805e3a235cf985b9/users/538b324be9bc4e8f8e38bf55ff6075a4/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:28.067856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f08f23331bd43cfb9774de98818525c', 'request_id': 'req-bb8ea3f9-7daf-429b-917f-38ba0245968f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:28.076019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f08f23331bd43cfb9774de98818525c', 'request_id': 'req-bb8ea3f9-7daf-429b-917f-38ba0245968f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:28.086424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f08f23331bd43cfb9774de98818525c', 'request_id': 'req-bb8ea3f9-7daf-429b-917f-38ba0245968f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:28.117522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] The token cache is being invalidate because project 3f08f23331bd43cfb9774de98818525c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:28.118109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:28.119017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bb8ea3f9-7daf-429b-917f-38ba0245968f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:28.120775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 858/1713] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:27 2022] DELETE /identity/v3/projects/3f08f23331bd43cfb9774de98818525c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:00:28.126996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:28.128126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:28.128547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:28.150174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:28.164373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:28.165605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:28.305867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 856/1714] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:28.315276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:28.315709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:28.316119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:28.369372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:28.371515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:28.408983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 859/1715] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:28.413201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:28.430187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d772647-55b5-4950-985c-041f5a9d1689 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:28.446860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:28.448594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:28.448594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:28.448594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:28.448925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:28.454470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:28.457089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:28.490524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 857/1716] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:28.500963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:28.521575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce2f43-930a-49bc-8c3c-932a026c02b1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:28.545086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:28.545739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:28.546017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:28.546285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:28.546935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:28.556433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:28.633932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 860/1717] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:28 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:28.638588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:28.657388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272dc88-c9a2-43f8-917e-ed960bf6f9cf admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:28.950695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:28.956175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:28.956488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:28.960273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:28.960993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:28.970001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:29.027238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 858/1718] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:28 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:29.027556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:29.041074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82269-215e-4b0d-baa1-6052fb109fa7 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:29.054873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:29.055563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.055823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.056102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.056764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:29.085385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:29.087455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:29.113269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 861/1719] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:29.116786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:29.131736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234704f8-ab26-42d8-9b64-25e0991ef3bf admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:29.146769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd47ab9-f7de-4e1e-88ab-e19f753c0ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:29.147488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd47ab9-f7de-4e1e-88ab-e19f753c0ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.147773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd47ab9-f7de-4e1e-88ab-e19f753c0ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.148048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd47ab9-f7de-4e1e-88ab-e19f753c0ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.148765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd47ab9-f7de-4e1e-88ab-e19f753c0ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:29.159126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd47ab9-f7de-4e1e-88ab-e19f753c0ba9 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:29.186900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 859/1720] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:29.191110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:29.211252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf42b-c75f-4fd6-8a2f-07b76c9a68f8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:29.222606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d67dc-42e8-4238-9959-0e976c939cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:29.223465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d67dc-42e8-4238-9959-0e976c939cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.223775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d67dc-42e8-4238-9959-0e976c939cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.225690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d67dc-42e8-4238-9959-0e976c939cd4 admin admin] PATH_INFO: `/v3/projects/5b70cc3ffcc443b8a2555321292da924/users/4d34c2bb654043e8bbb326bfc3a1d696/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.266720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d67dc-42e8-4238-9959-0e976c939cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b70cc3ffcc443b8a2555321292da924, user_id=4d34c2bb654043e8bbb326bfc3a1d696, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:29.269540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d67dc-42e8-4238-9959-0e976c939cd4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:29.300480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 862/1721] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:29 2022] PUT /identity/v3/projects/5b70cc3ffcc443b8a2555321292da924/users/4d34c2bb654043e8bbb326bfc3a1d696/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:29.312904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.314406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.314636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.380509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] MFA Rules not processed for user `4d34c2bb654043e8bbb326bfc3a1d696`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:29.381921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:29.561168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798cef0-b066-453f-b7e1-ee4e1ca60a71 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.561454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798cef0-b066-453f-b7e1-ee4e1ca60a71 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.561830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798cef0-b066-453f-b7e1-ee4e1ca60a71 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.563894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 863/1722] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 10:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:00:29.569658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.569998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.570277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.606688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:29.626922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 860/1723] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:29.630000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:29.702191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] MFA Rules not processed for user `e8980803eace443d849c22a6e0781894`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:29.706890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:29.819034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164279e1-cd9a-4bf3-8ecf-1ee77f2bd21d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:29.832398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:29.833363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:29.834139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:29.835393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:29.836974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:29.842616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:29.867195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 864/1724] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:29.900297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:29.901767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:29.909362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 861/1725] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:29 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:29.910705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:29.917384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fbf2-9b30-47db-9378-b7d8c7979ea2 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.058667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.059899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.062908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.063262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.067535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe79d-048b-4b7c-83fb-6e530799e666 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.080400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:30.081408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.082624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.082624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.082810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.083393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:30.085666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:30.086853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:30.106570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 865/1726] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:30.130050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 862/1727] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:29 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:30.131206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:30.148233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867de10-9e35-4d3b-83cb-01113e3577ec service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.162530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.163357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.163488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.163761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.165795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:30.167458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:30.191380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 866/1728] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:30.195947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:30.213964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe248ca-1c68-47d2-b931-e561cbb60157 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.221996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.221996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.221996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.222312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] PATH_INFO: `/v3/projects/cd899fc7d26749b6974e16e74b6508c5/users/88fdff08cf2d43218783a0ce1ceb540b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.268213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd899fc7d26749b6974e16e74b6508c5, user_id=88fdff08cf2d43218783a0ce1ceb540b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:30.274288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:30.304055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 863/1729] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:30 2022] PUT /identity/v3/projects/cd899fc7d26749b6974e16e74b6508c5/users/88fdff08cf2d43218783a0ce1ceb540b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:30.305265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:30.319918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb562b-8936-4e03-a097-c297c8bfae5d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.470746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c064b-a631-48d6-9e42-c3ca321952c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.471432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c064b-a631-48d6-9e42-c3ca321952c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.471709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c064b-a631-48d6-9e42-c3ca321952c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.471977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c064b-a631-48d6-9e42-c3ca321952c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.472644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c064b-a631-48d6-9e42-c3ca321952c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:30.474408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c064b-a631-48d6-9e42-c3ca321952c0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:30.476044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:30.497799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 867/1730] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:30.501778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:30.519871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869a4db-2701-4ee0-80f7-ecdc373c4b0b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.538812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.539545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.539821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.540091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] PATH_INFO: `/v3/projects/cd899fc7d26749b6974e16e74b6508c5/users/88fdff08cf2d43218783a0ce1ceb540b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.542012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd899fc7d26749b6974e16e74b6508c5, user_id=88fdff08cf2d43218783a0ce1ceb540b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:30.545128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:30.574016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 864/1731] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:30 2022] PUT /identity/v3/projects/cd899fc7d26749b6974e16e74b6508c5/users/88fdff08cf2d43218783a0ce1ceb540b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:30.584415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11170052-7b4d-466c-9d65-c522f456727f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.584759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11170052-7b4d-466c-9d65-c522f456727f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.585037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11170052-7b4d-466c-9d65-c522f456727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:30.632763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-11170052-7b4d-466c-9d65-c522f456727f None None] MFA Rules not processed for user `88fdff08cf2d43218783a0ce1ceb540b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:30.636027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-11170052-7b4d-466c-9d65-c522f456727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:30.757633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 868/1732] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:30.768870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:30.773027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:30.923807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:30.975651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349247-ccfc-4c5e-a2d8-7c84af9ca42c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:30.993428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954b01-9fef-4cb7-8e33-d42acb3a4fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:30.994071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954b01-9fef-4cb7-8e33-d42acb3a4fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:30.994382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954b01-9fef-4cb7-8e33-d42acb3a4fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:30.994650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954b01-9fef-4cb7-8e33-d42acb3a4fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:31.014899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954b01-9fef-4cb7-8e33-d42acb3a4fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:31.016495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954b01-9fef-4cb7-8e33-d42acb3a4fb7 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:31.046601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 865/1733] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:31.233286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11170052-7b4d-466c-9d65-c522f456727f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:31.250676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11170052-7b4d-466c-9d65-c522f456727f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:31.260609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e8fe1-2d98-4087-b704-cf48fb5ed7f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:31.262709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8fe1-2d98-4087-b704-cf48fb5ed7f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:31.263169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8fe1-2d98-4087-b704-cf48fb5ed7f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:31.264482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e8fe1-2d98-4087-b704-cf48fb5ed7f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:31.426773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e8fe1-2d98-4087-b704-cf48fb5ed7f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:31.429690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e8fe1-2d98-4087-b704-cf48fb5ed7f0 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:31.444200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 869/1734] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:31.503308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad54a6-5b1a-40cf-96b4-f4be19efc6df None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:31.503805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad54a6-5b1a-40cf-96b4-f4be19efc6df None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:31.503903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad54a6-5b1a-40cf-96b4-f4be19efc6df None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:31.506038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 866/1735] 10.222.0.65 () {54 vars in 961 bytes} [Wed Aug 24 10:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:00:31.521517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60723273-157f-4274-bfa0-ddcc9d2d820c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:31.521998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60723273-157f-4274-bfa0-ddcc9d2d820c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:31.522393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60723273-157f-4274-bfa0-ddcc9d2d820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:31.570687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-60723273-157f-4274-bfa0-ddcc9d2d820c None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:31.573759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-60723273-157f-4274-bfa0-ddcc9d2d820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:31.853013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad54a6-5b1a-40cf-96b4-f4be19efc6df None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:31.856223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 870/1736] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Aug 24 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:31.881382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad54a6-5b1a-40cf-96b4-f4be19efc6df None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:31.921790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:31.922761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:31.923339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:31.923819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:31.926441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:31.950390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:31.952808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60e727-dad2-4f40-8b25-06d2bd1231a6 service placement] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:31.982366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:31.982366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:31.982366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:31.996238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 867/1737] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:32.106231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] MFA Rules not processed for user `cf76e4d108e140508be72bd1afd5ca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:32.107536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:32.120085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:32.349588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 871/1738] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:32.362226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4abf24-c2c8-470d-aecb-1110b05852e5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:32.362648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4abf24-c2c8-470d-aecb-1110b05852e5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:32.363358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4abf24-c2c8-470d-aecb-1110b05852e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:32.403993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2d4abf24-c2c8-470d-aecb-1110b05852e5 None None] MFA Rules not processed for user `cf76e4d108e140508be72bd1afd5ca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:32.405646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2d4abf24-c2c8-470d-aecb-1110b05852e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:32.424785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 868/1739] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:32.431967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:32.433444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:32.632410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b4e6-68c5-426c-9e3f-f1fbf343f42b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:32.640996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c59fb-1a2a-4000-8f8f-1c168833a8db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:32.654146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c59fb-1a2a-4000-8f8f-1c168833a8db service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:32.654657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c59fb-1a2a-4000-8f8f-1c168833a8db service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:32.655038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c59fb-1a2a-4000-8f8f-1c168833a8db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:32.705376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c59fb-1a2a-4000-8f8f-1c168833a8db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:32.709704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c59fb-1a2a-4000-8f8f-1c168833a8db service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:32.749855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 872/1740] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:34.172403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ac5b-be6b-4dc1-9d7e-f6413f6e2d33 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:34.173072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ac5b-be6b-4dc1-9d7e-f6413f6e2d33 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:34.173436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ac5b-be6b-4dc1-9d7e-f6413f6e2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:34.241431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a3f1ac5b-be6b-4dc1-9d7e-f6413f6e2d33 None None] MFA Rules not processed for user `b63914ce814a43078a1c177cff9a89fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:34.242779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a3f1ac5b-be6b-4dc1-9d7e-f6413f6e2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:34.422947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 869/1741] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:34.435175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:34.435703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:34.435922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:34.473838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] MFA Rules not processed for user `b63914ce814a43078a1c177cff9a89fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:34.477412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:34.498271 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae369-acdf-4de9-a989-43c20a35a0e4 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:34.498758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 873/1742] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:34.509278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae369-acdf-4de9-a989-43c20a35a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:34.509780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae369-acdf-4de9-a989-43c20a35a0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:34.511889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:34.514354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:34.552955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958c27-2e9a-4b66-915a-f05738983cc8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:34.553364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-1dfae369-acdf-4de9-a989-43c20a35a0e4 None None] MFA Rules not processed for user `cf76e4d108e140508be72bd1afd5ca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:34.555549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1dfae369-acdf-4de9-a989-43c20a35a0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:34.567864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:34.572425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:34.572672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 870/1743] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:34.572924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:34.573295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:34.587259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:34.589277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:34.599127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cc454-2e7f-4572-a17f-6b38c0fe1a2c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:34.599669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cc454-2e7f-4572-a17f-6b38c0fe1a2c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:34.600044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cc454-2e7f-4572-a17f-6b38c0fe1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:34.611278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 874/1744] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:34.658550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-408cc454-2e7f-4572-a17f-6b38c0fe1a2c None None] MFA Rules not processed for user `538b324be9bc4e8f8e38bf55ff6075a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:34.661743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-408cc454-2e7f-4572-a17f-6b38c0fe1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:34.864838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 871/1745] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:34.944230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:35.113771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbdcb-87ec-4cca-95af-83750f24e840 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:35.126497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:35.127524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:35.127810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:35.128078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] PATH_INFO: `/v3/users/4d34c2bb654043e8bbb326bfc3a1d696` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:35.133069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d34c2bb654043e8bbb326bfc3a1d696)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:35.152385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:35.188280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:35.296007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d34c2bb654043e8bbb326bfc3a1d696'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.296712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d34c2bb654043e8bbb326bfc3a1d696'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.320107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d34c2bb654043e8bbb326bfc3a1d696'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.320815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d34c2bb654043e8bbb326bfc3a1d696'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.330526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d34c2bb654043e8bbb326bfc3a1d696'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.370462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 875/1746] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:34 2022] DELETE /identity/v3/users/4d34c2bb654043e8bbb326bfc3a1d696 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:35.374972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:35.376013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:35.376383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:35.395933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:35.398973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:35.430560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:35.434480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:35.561079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:35.565347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cb56-39b7-43b6-99f6-6198d288e068 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:35.582586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:35.583382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:35.583643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:35.583916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] PATH_INFO: `/v3/users/498f519146ba4b8ea7d1eddf4aecc28d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:35.585987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498f519146ba4b8ea7d1eddf4aecc28d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:35.588124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:35.731044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 872/1747] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:35.743122 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498f519146ba4b8ea7d1eddf4aecc28d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.744150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498f519146ba4b8ea7d1eddf4aecc28d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.768794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498f519146ba4b8ea7d1eddf4aecc28d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.769329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498f519146ba4b8ea7d1eddf4aecc28d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.788875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cd15ad3d-6c5b-4f64-8c28-634fffe12476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498f519146ba4b8ea7d1eddf4aecc28d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:35.834409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:35.836656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:35.851583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 876/1748] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:35 2022] DELETE /identity/v3/users/498f519146ba4b8ea7d1eddf4aecc28d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:35.856790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:35.857075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:35.857394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:35.933505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:35.935506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:35.948441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:35.978041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4737ab-418f-40c5-830b-0fef589967a8 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:36.130423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 877/1749] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:36.157334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:36.158878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:36.207003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:36.212986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:36.213304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:36.213578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:36.218560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:36.258931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:36.262880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a4426-abc4-4035-9e2f-4ba8cf8acc86 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:36.285110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a761-135a-4098-a0c3-dfc51435f0c2 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:36.293955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:36.296174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:36.296608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:36.296976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:36.322816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:36.324447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:36.335713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 873/1750] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:36.340533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa7789-d1fa-4251-a50a-ab36dde8f4de None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:36.340884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa7789-d1fa-4251-a50a-ab36dde8f4de None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:36.341166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa7789-d1fa-4251-a50a-ab36dde8f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:36.345079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 878/1751] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:36.508981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-99fa7789-d1fa-4251-a50a-ab36dde8f4de None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:36.510328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-99fa7789-d1fa-4251-a50a-ab36dde8f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:36.717434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:36.739597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 874/1752] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:37.020551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:37.022819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:37.260311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835146d-0760-4384-b229-116ea973b69e service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:37.267895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f705d0-add3-4cde-bec6-561c1543dd9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:37.268597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f705d0-add3-4cde-bec6-561c1543dd9e service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:37.268932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f705d0-add3-4cde-bec6-561c1543dd9e service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:37.269570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f705d0-add3-4cde-bec6-561c1543dd9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:37.281560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f705d0-add3-4cde-bec6-561c1543dd9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:37.284046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f705d0-add3-4cde-bec6-561c1543dd9e service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:37.299273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 879/1753] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:00:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:00:37.343895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5592ef-82ae-4798-97b5-9be65887a8f1 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:37.344184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5592ef-82ae-4798-97b5-9be65887a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:37.344468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5592ef-82ae-4798-97b5-9be65887a8f1 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:37.346140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 875/1754] 10.222.0.65 () {54 vars in 912 bytes} [Wed Aug 24 10:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:00:37.358065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:37.358470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:37.358911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:37.417865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] MFA Rules not processed for user `e8980803eace443d849c22a6e0781894`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:37.422010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:37.461873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 880/1755] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:37.497723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6512-72a8-45ea-9f4d-6eb19838ae8b None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:37.498020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6512-72a8-45ea-9f4d-6eb19838ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:37.498296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6512-72a8-45ea-9f4d-6eb19838ae8b None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:37.499682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 876/1756] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:00:37.536778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:37.538462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:37.562396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:37.562928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:37.563065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:37.580746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2d21-4cf4-405f-b4bc-4052aae5e86e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:37.609396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:37.610024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:37.610303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:37.610624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:37.644903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:37.653991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:37.657320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:37.660414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:37.719820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 881/1757] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:37.863538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 877/1758] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:38.098028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:38.100635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:38.135917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:38.145374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87974c67-80c3-4b6f-8846-8260eb913256 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:38.161616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9de6-4122-428c-a3c2-d67891d3436e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:38.161951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9de6-4122-428c-a3c2-d67891d3436e service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:38.162429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9de6-4122-428c-a3c2-d67891d3436e service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:38.162809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9de6-4122-428c-a3c2-d67891d3436e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:38.195494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f9de6-4122-428c-a3c2-d67891d3436e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:38.202419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f9de6-4122-428c-a3c2-d67891d3436e service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:38.256641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 882/1759] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:39.165114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:39.166604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:39.192230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb048b15-3523-4dcb-8d12-dad3a73d184e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:39.203688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:39.204930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:39.205410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:39.220342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:39.221005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:39.221283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:39.221555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] PATH_INFO: `/v3/projects/5b70cc3ffcc443b8a2555321292da924` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:39.223084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b70cc3ffcc443b8a2555321292da924)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:39.225439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:39.274194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] MFA Rules not processed for user `9579f6a06b1743039bb5c3db8e88e460`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:39.278808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:39.392021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b70cc3ffcc443b8a2555321292da924', 'request_id': 'req-3f07fef1-3bc3-4b09-8496-d166d2d7524d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:39.418763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b70cc3ffcc443b8a2555321292da924', 'request_id': 'req-3f07fef1-3bc3-4b09-8496-d166d2d7524d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:39.435044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b70cc3ffcc443b8a2555321292da924', 'request_id': 'req-3f07fef1-3bc3-4b09-8496-d166d2d7524d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:39.469108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] The token cache is being invalidate because project 5b70cc3ffcc443b8a2555321292da924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:39.469318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 883/1760] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:39.469925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:39.471409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:39.477915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:39.477915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:39.478542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 878/1761] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:39 2022] DELETE /identity/v3/projects/5b70cc3ffcc443b8a2555321292da924 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:39.479677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:39.500662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:39.673277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27bfb-2edb-4b06-87f0-c5524aa7a0f9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:39.789859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07fef1-3bc3-4b09-8496-d166d2d7524d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:39.813613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:39.814294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:39.814577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:39.814851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] PATH_INFO: `/v3/users/88fdff08cf2d43218783a0ce1ceb540b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:39.819268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fdff08cf2d43218783a0ce1ceb540b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:39.821379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:39.911465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:39.925280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:39.925924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:39.926202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:39.926474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:39.932671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:39.992946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:40.022569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fdff08cf2d43218783a0ce1ceb540b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:40.026963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fdff08cf2d43218783a0ce1ceb540b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:40.030528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fdff08cf2d43218783a0ce1ceb540b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:40.048212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fdff08cf2d43218783a0ce1ceb540b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:40.071707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c1035b2e-7771-431e-8013-82d93872277b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fdff08cf2d43218783a0ce1ceb540b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:40.121602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 879/1762] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:39 2022] DELETE /identity/v3/users/88fdff08cf2d43218783a0ce1ceb540b => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:40.127077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:40.127406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:40.127682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:40.187242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:40.188888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606702f-1458-433a-98d8-d93ad5b514e7 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:40.192682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] MFA Rules not processed for user `7b478a587aa7484898b16e6fd5564253`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:40.198279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:40.231001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 884/1763] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 756 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:00:40.479871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 880/1764] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:41.216040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:41.216323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:41.216990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:41.300032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] MFA Rules not processed for user `e8980803eace443d849c22a6e0781894`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:41.308963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:41.507004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 885/1765] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Aug 24 10:00:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:41.579027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:41.581172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:41.623943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2faae2-eb9a-4e50-be68-d0179e53cb19 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:41.641702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:41.647435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:41.647758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:41.648431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:41.673077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:41.675983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:41.687473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 881/1766] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:42.601591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:42.604161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:42.766453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4b657-f5e3-468a-a4a6-fc6280978df1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:42.766696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:42.768356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:42.775605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:42.776830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:42.777460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:42.778606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] PATH_INFO: `/v3/projects/cd899fc7d26749b6974e16e74b6508c5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:42.781265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd899fc7d26749b6974e16e74b6508c5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:42.784033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:42.812280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03880d-b1b7-4dca-9589-f86e69715779 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:42.827585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:42.828253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:42.828543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:42.828894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] PATH_INFO: `/v3/projects/a0e6341184b44699bd135388b1eec9b1` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:42.837365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e6341184b44699bd135388b1eec9b1)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:42.839318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:42.895703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd899fc7d26749b6974e16e74b6508c5', 'request_id': 'req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.914729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd899fc7d26749b6974e16e74b6508c5', 'request_id': 'req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.928702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd899fc7d26749b6974e16e74b6508c5', 'request_id': 'req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.939405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:42.949254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e6341184b44699bd135388b1eec9b1', 'request_id': 'req-7c4ec133-c3de-4203-8d9a-9c3c294e2464'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.971976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] The token cache is being invalidate because project cd899fc7d26749b6974e16e74b6508c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:42.972443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.974742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9721b085-578b-4540-9a0e-6e4ecbfbdcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.977084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e6341184b44699bd135388b1eec9b1', 'request_id': 'req-7c4ec133-c3de-4203-8d9a-9c3c294e2464'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:42.982238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 886/1767] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:42 2022] DELETE /identity/v3/projects/cd899fc7d26749b6974e16e74b6508c5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:42.988131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5e62-8593-412d-95c8-ef19398dce0e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:42.988495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5e62-8593-412d-95c8-ef19398dce0e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:42.992223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5e62-8593-412d-95c8-ef19398dce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:43.001988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e6341184b44699bd135388b1eec9b1', 'request_id': 'req-7c4ec133-c3de-4203-8d9a-9c3c294e2464'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.044220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] The token cache is being invalidate because project a0e6341184b44699bd135388b1eec9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:43.044519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.054837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-aaaa5e62-8593-412d-95c8-ef19398dce0e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:43.058624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-aaaa5e62-8593-412d-95c8-ef19398dce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:43.058813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.063654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 882/1768] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:42 2022] DELETE /identity/v3/projects/a0e6341184b44699bd135388b1eec9b1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:43.068960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:43.076304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:43.125607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:43.281275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 887/1769] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:43.290872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:43.291216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:43.291442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:43.330984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ec133-c3de-4203-8d9a-9c3c294e2464 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:43.344481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:43.345151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:43.353876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:43.354444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:43.354850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:43.355004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] PATH_INFO: `/v3/users/6e3d923b7c7f423e8de3a67c887aa034` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:43.359409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3d923b7c7f423e8de3a67c887aa034)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:43.362290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:43.368406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 888/1770] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:43.372496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:43.395003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e771de-c311-46b2-b4a4-cbcc7890f60b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:43.409883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:43.410579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:43.410856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:43.411395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:43.412275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:43.412582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:43.414222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:43.449001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 889/1771] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:43.459636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:43.506164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3d923b7c7f423e8de3a67c887aa034'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.506490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf392b-03af-4e0b-b5a5-ec34becfb57f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:43.507519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3d923b7c7f423e8de3a67c887aa034'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.510932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3d923b7c7f423e8de3a67c887aa034'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.525228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:43.529633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:43.530448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:43.532104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:43.532909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:43.533368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3d923b7c7f423e8de3a67c887aa034'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.540162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:43.558422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3d923b7c7f423e8de3a67c887aa034'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:43.618640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 883/1772] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:43 2022] DELETE /identity/v3/users/6e3d923b7c7f423e8de3a67c887aa034 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:43.653605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 890/1773] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:43 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:43.658252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:43.663737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:43.875031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6762b-6501-4736-aeae-c45cb09fddd4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:44.041799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:44.115852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:44.116603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.116943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.117325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.118037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:44.120221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:44.189480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 884/1774] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:43 2022] POST /identity/v3/users => generated 290 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:44.189683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:44.205204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc824ed5-0933-485f-83a4-97aca964442e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:44.242272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:44.242935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.243243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.252337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.255791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:44.269276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:44.314978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 891/1775] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:44.323131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:44.340652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be566-cbcb-40e4-b90f-52b0007445ad admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:44.362207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451292-c9b4-4d77-bbbc-2815082b9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:44.362863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451292-c9b4-4d77-bbbc-2815082b9069 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.363183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451292-c9b4-4d77-bbbc-2815082b9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.364765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451292-c9b4-4d77-bbbc-2815082b9069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.366973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451292-c9b4-4d77-bbbc-2815082b9069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:44.372756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451292-c9b4-4d77-bbbc-2815082b9069 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:44.420733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:44.428204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 885/1776] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:44.433774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898e5fd-4f67-4b15-980c-aae7298873c3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:44.449149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff085-6706-4f30-ae31-e9ec603b9aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:44.450017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff085-6706-4f30-ae31-e9ec603b9aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.450303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff085-6706-4f30-ae31-e9ec603b9aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.450881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff085-6706-4f30-ae31-e9ec603b9aff admin admin] PATH_INFO: `/v3/projects/7a2c0b4619374f7abac51d49afba8c10/users/d4ae0c81676d46febc162c7f0f47484f/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.516382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff085-6706-4f30-ae31-e9ec603b9aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2c0b4619374f7abac51d49afba8c10, user_id=d4ae0c81676d46febc162c7f0f47484f, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:44.519908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff085-6706-4f30-ae31-e9ec603b9aff admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:44.565585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.565913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.566152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.571718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 892/1777] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:44 2022] PUT /identity/v3/projects/7a2c0b4619374f7abac51d49afba8c10/users/d4ae0c81676d46febc162c7f0f47484f/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:44.581349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6513-072f-4122-a1df-488dc54ccac6 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.581636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6513-072f-4122-a1df-488dc54ccac6 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.581908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6513-072f-4122-a1df-488dc54ccac6 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.583910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 893/1778] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:00:44.623997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:44.624276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:44.624746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:44.632742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] MFA Rules not processed for user `d4ae0c81676d46febc162c7f0f47484f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:44.640900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:44.676669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] MFA Rules not processed for user `087bb494630b463b841d23a1eaaed9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:44.678117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:44.920588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 886/1779] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:44.923777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:44.937635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:45.118368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 894/1780] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:00:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 10:00:45.121252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:45.220635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:45.353280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3acdd-84cc-4f0c-8390-c003ddf670d1 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:45.375299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:45.383560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:45.384155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:45.384433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] PATH_INFO: `/v3/users/2d19c386e7744e078c02d3c4c477fa42` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:45.395142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d19c386e7744e078c02d3c4c477fa42)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:45.401857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:45.449144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2b08-8a44-4de7-8b9d-2d75871cfae4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:45.479336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:45.479990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:45.480274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:45.480551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:45.481195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:45.483169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:45.568817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d19c386e7744e078c02d3c4c477fa42'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:45.571452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d19c386e7744e078c02d3c4c477fa42'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:45.576924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d19c386e7744e078c02d3c4c477fa42'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:45.577480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 895/1781] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:45 2022] POST /identity/v3/projects => generated 377 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:45.578546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:45.581723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:45.585250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:45.603896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d19c386e7744e078c02d3c4c477fa42'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:45.620390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d19c386e7744e078c02d3c4c477fa42'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:45.676485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 887/1782] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:44 2022] DELETE /identity/v3/users/2d19c386e7744e078c02d3c4c477fa42 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:45.677505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:45.681087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:45.726895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308916b2-8e41-4377-b657-deaff73015ab admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:45.810148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19485421-a4f7-4a6a-a82c-4081abfeb96f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:45.867592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:45.869551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:45.869993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:45.870430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:45.872609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:45.883284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:45.929971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:45.932272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:45.936013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:45.937879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:45.945165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:45.965520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 888/1783] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:45 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:45.970312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:45.984920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:45.986955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:46.010644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7ed4-ae98-4da0-a3bc-1417bcd58ff5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:46.018753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 896/1784] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:46.041156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:46.042458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:46.043352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:46.043788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:46.046199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:46.048099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:46.084399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:46.084987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 889/1785] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:46.105376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6235b8-3000-4a19-b3f4-95a1e6c6e3ca service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:46.121323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c8fad-53a5-4034-9c7e-ccb59bc3695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:46.122285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8fad-53a5-4034-9c7e-ccb59bc3695a admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:46.127202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8fad-53a5-4034-9c7e-ccb59bc3695a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:46.128287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c8fad-53a5-4034-9c7e-ccb59bc3695a admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:46.129181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c8fad-53a5-4034-9c7e-ccb59bc3695a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:46.133766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c8fad-53a5-4034-9c7e-ccb59bc3695a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:46.163952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 897/1786] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:46.171730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:46.196931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cff55-9f58-42f5-8de0-60d4513bf0c0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:46.252150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:46.253334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:46.255292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:46.255840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] PATH_INFO: `/v3/projects/4e376a1e97454dfda4bbf559e2dc9b56/users/c3e5250d72ae414bbec424e8a7f6c3ed/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:46.338135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e376a1e97454dfda4bbf559e2dc9b56, user_id=c3e5250d72ae414bbec424e8a7f6c3ed, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:46.356768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:46.393604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 890/1787] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:46 2022] PUT /identity/v3/projects/4e376a1e97454dfda4bbf559e2dc9b56/users/c3e5250d72ae414bbec424e8a7f6c3ed/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:46.407294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:46.407963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:46.408485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:46.497123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] MFA Rules not processed for user `c3e5250d72ae414bbec424e8a7f6c3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:46.499425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:46.535391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:46.712305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 898/1788] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:46.714197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:46.894383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2167-5038-49f0-b60e-7763f955462f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:46.910256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:46.911228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:46.911911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:46.912355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:46.913200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:46.921619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:46.984568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 891/1789] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:46 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:46.988961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:47.010581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe47df-4b16-4a67-8313-99b47e658595 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:47.148379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:47.149036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:47.149323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:47.149608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:47.150265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:47.152512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:47.209647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 899/1790] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:46 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:47.210901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:47.222966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5777-98cd-4de0-8d07-513be831863e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:47.239231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:47.239968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:47.240253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:47.241113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:47.241223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:47.250043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:47.251969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:47.281258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 892/1791] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:47.282084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:47.310588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263adf94-251b-4459-9785-987735c69a40 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:47.324416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:47.325133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:47.325418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:47.325697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] PATH_INFO: `/v3/projects/30d2fc3619d14001a825dabd897b38ad/users/01e9c4414a5e4577ac1aad75cab88d5e/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:47.376567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d2fc3619d14001a825dabd897b38ad, user_id=01e9c4414a5e4577ac1aad75cab88d5e, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:47.384136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:47.428018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 900/1792] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:47 2022] PUT /identity/v3/projects/30d2fc3619d14001a825dabd897b38ad/users/01e9c4414a5e4577ac1aad75cab88d5e/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:47.430990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:47.450582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc6de-0b2d-4884-8761-394b71a6fbec admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:47.606640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d11c46-5738-4d20-9c24-ff7252a884ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:47.607597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d11c46-5738-4d20-9c24-ff7252a884ed admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:47.608035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d11c46-5738-4d20-9c24-ff7252a884ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:47.608456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d11c46-5738-4d20-9c24-ff7252a884ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:47.609276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d11c46-5738-4d20-9c24-ff7252a884ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:47.611245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d11c46-5738-4d20-9c24-ff7252a884ed admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:47.641347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 893/1793] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:47.646487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:47.677649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0948-2cb4-4c73-a36d-df8a9339d26f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:47.699285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:47.700126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:47.700485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:47.701147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] PATH_INFO: `/v3/projects/30d2fc3619d14001a825dabd897b38ad/users/01e9c4414a5e4577ac1aad75cab88d5e/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:47.705931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d2fc3619d14001a825dabd897b38ad, user_id=01e9c4414a5e4577ac1aad75cab88d5e, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:47.724088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:47.779575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 901/1794] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:47 2022] PUT /identity/v3/projects/30d2fc3619d14001a825dabd897b38ad/users/01e9c4414a5e4577ac1aad75cab88d5e/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:47.792391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:47.792819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:47.793189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:47.868965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] MFA Rules not processed for user `01e9c4414a5e4577ac1aad75cab88d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:47.870205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:48.017487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 894/1795] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:48.030546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:48.032292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:48.186153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e136fed-ac29-4cbf-962c-9b3698155e79 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:48.209786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:48.210447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:48.210731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:48.211005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:48.228821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:48.230735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:48.269244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 902/1796] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:48.355416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:48.357153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:48.394791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b51f21-8550-4fb2-a2af-15570a46c60b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:48.404317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:48.405284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:48.405760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:48.406182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:48.408405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:48.457712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:48.461837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:48.469650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:48.609240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:48.619733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e192295-2c62-4bc2-95ea-2e4c24470a64 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:48.622106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9a91-a9fc-456d-90bc-a862cfd1b519 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:48.657676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:48.657676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:48.657676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:48.657676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] PATH_INFO: `/v3/projects/de358812bbda40e9b59566194b1689e7` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:48.664096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de358812bbda40e9b59566194b1689e7)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:48.667292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:48.676555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 895/1797] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:48.859137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de358812bbda40e9b59566194b1689e7', 'request_id': 'req-a42304ed-a85a-4c84-82ae-a3251e1f6160'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:48.875775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de358812bbda40e9b59566194b1689e7', 'request_id': 'req-a42304ed-a85a-4c84-82ae-a3251e1f6160'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:48.892635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de358812bbda40e9b59566194b1689e7', 'request_id': 'req-a42304ed-a85a-4c84-82ae-a3251e1f6160'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:48.928139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] The token cache is being invalidate because project de358812bbda40e9b59566194b1689e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:48.928472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:48.931472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a42304ed-a85a-4c84-82ae-a3251e1f6160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:48.940632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 903/1798] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:48 2022] DELETE /identity/v3/projects/de358812bbda40e9b59566194b1689e7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:48.942192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:48.942509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:48.942791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.004255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:49.005570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:49.039754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:49.218365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 896/1799] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:49.225776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.226965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.227434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.297678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:49.299013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:49.339994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:49.347729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 904/1800] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:49.357445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ff04-9333-4c01-9a30-c0753524ab0e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:49.379684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:49.382328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.386267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.386752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.387527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:49.389094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:49.400904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:49.473376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 897/1801] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:49.478713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:49.494421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f52a91-7440-4d2e-9e66-9da40617e882 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:49.501236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:49.503345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.503345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.503345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.503345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:49.520086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:49.582401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 905/1802] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:49 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:49.586723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:49.603721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bfeff-bffb-405c-ac9b-f3b218085d6b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:49.783652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:49.784704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.785182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.785602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.786605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:49.789351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:49.844231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 898/1803] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:49 2022] POST /identity/v3/users => generated 278 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:49.848313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:49.861446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcdbeb-52b9-4aba-bd17-392c9622c391 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:49.867195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:49.868138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.868581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.868857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.869522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:49.871345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:49.887404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 906/1804] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:49.889196 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:49.904571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94670fa-6b99-4279-a55e-ca10e9101b95 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:49.918595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02ce81-7a00-4c2d-acd4-0ed7de0c8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:49.919583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02ce81-7a00-4c2d-acd4-0ed7de0c8358 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.920024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02ce81-7a00-4c2d-acd4-0ed7de0c8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.920444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02ce81-7a00-4c2d-acd4-0ed7de0c8358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.921252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02ce81-7a00-4c2d-acd4-0ed7de0c8358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:49.923040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02ce81-7a00-4c2d-acd4-0ed7de0c8358 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:49.984790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 899/1805] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:49.989202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:50.003441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f46f9-d3d1-41f8-9e5a-6e731da26cf4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:50.029861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:50.030775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:50.031263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:50.031699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] PATH_INFO: `/v3/projects/d04f93a333854238a61673744de761a3/users/410f490f00bf49a7b86d6eafbe5d3f56/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:50.087618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04f93a333854238a61673744de761a3, user_id=410f490f00bf49a7b86d6eafbe5d3f56, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:50.093531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:50.144102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 907/1806] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:49 2022] PUT /identity/v3/projects/d04f93a333854238a61673744de761a3/users/410f490f00bf49a7b86d6eafbe5d3f56/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:50.163420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc188-e994-4f3b-989a-7489c412a718 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:50.164301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc188-e994-4f3b-989a-7489c412a718 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:50.165018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc188-e994-4f3b-989a-7489c412a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:50.228021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-41ecc188-e994-4f3b-989a-7489c412a718 None None] MFA Rules not processed for user `410f490f00bf49a7b86d6eafbe5d3f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:50.229633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-41ecc188-e994-4f3b-989a-7489c412a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:50.403382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 900/1807] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:50.408588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:50.454073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c534d-a30b-4386-9965-4c63853814fa None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:50.454619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c534d-a30b-4386-9965-4c63853814fa None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:50.455086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c534d-a30b-4386-9965-4c63853814fa None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:50.456973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 901/1808] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:00:50.533244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:50.605292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84585a-3ffd-4c3c-aef7-bef695984c64 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:50.615004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:50.618649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:50.620430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:50.625791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:50.630666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:50.640306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:50.640588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:50.640698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:50.640858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:50.694651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:50.696610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:50.713439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:50.743487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 908/1809] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:50 2022] POST /identity/v3/projects => generated 357 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:50.744919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:50.755170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:50.921279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 902/1810] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:50.925642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:50.984337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2e10-9775-4949-873c-b79af653469c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:51.007842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:51.008481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:51.008763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:51.009030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:51.009666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:51.021538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6ecd-a429-4205-ac75-6bb7fbc1a9b3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:51.035960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:51.037658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:51.038054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:51.038438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] PATH_INFO: `/v3/projects/3cce86283c7446e48d0069a04b50fbfb` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:51.039714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:51.042709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cce86283c7446e48d0069a04b50fbfb)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:51.048639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:51.094183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 903/1811] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:50 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:51.095069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:51.102579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:51.176142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cce86283c7446e48d0069a04b50fbfb', 'request_id': 'req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.191572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cce86283c7446e48d0069a04b50fbfb', 'request_id': 'req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.203770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cce86283c7446e48d0069a04b50fbfb', 'request_id': 'req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.246058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] The token cache is being invalidate because project 3cce86283c7446e48d0069a04b50fbfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:51.247481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.247481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.249851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 909/1812] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:50 2022] DELETE /identity/v3/projects/3cce86283c7446e48d0069a04b50fbfb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:51.251495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:51.256176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:51.337427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6e2a-a934-449d-8b95-820634e5794e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:51.408016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:51.458210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6481ba9-7b6b-4d8f-991f-1a811ff43aef admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:51.463922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:51.464540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:51.464803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:51.465075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:51.470164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:51.472821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:51.474207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:51.474607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:51.475223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:51.478399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:51.481274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:51.496327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:51.500662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:51.516505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 910/1813] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:51.517708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:51.519625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:51.527420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 904/1814] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:51.528303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:51.548691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ce97-a3b7-4749-935a-946d0668a5d0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:51.551143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c143c1-932e-4f22-878c-192d6fbf981f service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:51.572786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:51.573751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:51.574046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:51.574323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:51.574631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:51.574913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:51.575256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] PATH_INFO: `/v3/projects/8d27501ff1ec4a498449b5d2dd6ac18d/users/3810c48dee49496d8cdab9bdc0f4a580/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:51.575434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] PATH_INFO: `/v3/users/538b324be9bc4e8f8e38bf55ff6075a4` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:51.579771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538b324be9bc4e8f8e38bf55ff6075a4)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:51.582848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:51.584784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:51.609324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d27501ff1ec4a498449b5d2dd6ac18d, user_id=3810c48dee49496d8cdab9bdc0f4a580, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:51.616755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:51.644561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 905/1815] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:51 2022] PUT /identity/v3/projects/8d27501ff1ec4a498449b5d2dd6ac18d/users/3810c48dee49496d8cdab9bdc0f4a580/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:51.649718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:51.696967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538b324be9bc4e8f8e38bf55ff6075a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.697717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538b324be9bc4e8f8e38bf55ff6075a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.715416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538b324be9bc4e8f8e38bf55ff6075a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.716073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538b324be9bc4e8f8e38bf55ff6075a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.731302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66474fe7-1b95-4ef0-a589-bf9fe96dd7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538b324be9bc4e8f8e38bf55ff6075a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:51.769775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 911/1816] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:51 2022] DELETE /identity/v3/users/538b324be9bc4e8f8e38bf55ff6075a4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:51.853529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588457-fd2c-4ccf-906a-a07866ac831a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:52.114624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a629-b4e0-490a-b73b-d7f24f176cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:52.118757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a629-b4e0-490a-b73b-d7f24f176cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.126852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a629-b4e0-490a-b73b-d7f24f176cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.128473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a629-b4e0-490a-b73b-d7f24f176cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.129240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a629-b4e0-490a-b73b-d7f24f176cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:52.144854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171a629-b4e0-490a-b73b-d7f24f176cc1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:52.160965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87878c36-d724-4bfa-ac75-9af54f5e2fe0 None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.161285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87878c36-d724-4bfa-ac75-9af54f5e2fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.161529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87878c36-d724-4bfa-ac75-9af54f5e2fe0 None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.164682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 912/1817] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:00:52.195028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87878c36-d724-4bfa-ac75-9af54f5e2fe0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:52.197556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-87878c36-d724-4bfa-ac75-9af54f5e2fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:52.204875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 906/1818] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 556 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:52.246603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.248012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.248359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.249128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87878c36-d724-4bfa-ac75-9af54f5e2fe0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:52.271307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe843-e036-4ef3-b4e4-0af096b52450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:52.272901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe843-e036-4ef3-b4e4-0af096b52450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.273365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe843-e036-4ef3-b4e4-0af096b52450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.274335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe843-e036-4ef3-b4e4-0af096b52450 admin admin] PATH_INFO: `/v3/projects/8d27501ff1ec4a498449b5d2dd6ac18d/users/3810c48dee49496d8cdab9bdc0f4a580/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.288232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe843-e036-4ef3-b4e4-0af096b52450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d27501ff1ec4a498449b5d2dd6ac18d, user_id=3810c48dee49496d8cdab9bdc0f4a580, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:52.291438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:52.292537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:52.300198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe843-e036-4ef3-b4e4-0af096b52450 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:52.324645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 913/1819] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:52 2022] PUT /identity/v3/projects/8d27501ff1ec4a498449b5d2dd6ac18d/users/3810c48dee49496d8cdab9bdc0f4a580/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:00:52.337172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.337496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.337932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.433513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] MFA Rules not processed for user `3810c48dee49496d8cdab9bdc0f4a580`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:52.438154 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:52.506776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 907/1820] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:52.655865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 914/1821] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:52.669684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:52.671132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:52.698559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:52.758121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c348bd-c526-4db2-8275-155802e0ae77 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:52.841795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:52.842577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.842911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.844104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.855006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:52.856588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:52.867881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 908/1822] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:53.008570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:53.026029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97081877-77f5-4632-93d5-4aa68a3d20d2 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:53.035508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:53.040867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.041359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.048160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.051901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.091256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:53.093757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.118662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:53.217815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:53.219341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:53.228095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c4e1d-fe2d-44b8-955e-361c2740be17 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:53.235248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4f1de-fa11-41a0-8168-4c1f59886d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:53.237591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f1de-fa11-41a0-8168-4c1f59886d83 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.237962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f1de-fa11-41a0-8168-4c1f59886d83 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.238342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f1de-fa11-41a0-8168-4c1f59886d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.244096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 915/1823] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:53.247414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:53.250824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.282170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4f1de-fa11-41a0-8168-4c1f59886d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:53.284450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4f1de-fa11-41a0-8168-4c1f59886d83 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:53.315460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 909/1824] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:53.350242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc93c32-40ef-4761-b8bb-745b16cc7539 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:53.356032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:53.356694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.357580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.357580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] PATH_INFO: `/v3/users/d4ae0c81676d46febc162c7f0f47484f` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.358693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ae0c81676d46febc162c7f0f47484f)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:53.361098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:53.463832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.465254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.465490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.487823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ae0c81676d46febc162c7f0f47484f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.488864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ae0c81676d46febc162c7f0f47484f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.502890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] MFA Rules not processed for user `9579f6a06b1743039bb5c3db8e88e460`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:53.504899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.513236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ae0c81676d46febc162c7f0f47484f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.514274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ae0c81676d46febc162c7f0f47484f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.528023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d39fff39-2081-4299-9fe5-87732db75ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ae0c81676d46febc162c7f0f47484f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.578119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 916/1825] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:53 2022] DELETE /identity/v3/users/d4ae0c81676d46febc162c7f0f47484f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:53.580496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.580496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.580827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.618624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:53.620845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.634554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 910/1826] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:53.688120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:53.710560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:53.713956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.730018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 917/1827] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:53.746780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8d64a-3c2b-4222-903c-2435e6882fd5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:53.751973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:53.752711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:53.753381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.753656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.753763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:53.753932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] PATH_INFO: `/v3/projects/b41e11af95924026805e3a235cf985b9` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.755118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41e11af95924026805e3a235cf985b9)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:53.758374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:53.762031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:53.827267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41e11af95924026805e3a235cf985b9', 'request_id': 'req-c47f569f-3190-48a5-bed8-7d49836fe96f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.837716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41e11af95924026805e3a235cf985b9', 'request_id': 'req-c47f569f-3190-48a5-bed8-7d49836fe96f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.846492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41e11af95924026805e3a235cf985b9', 'request_id': 'req-c47f569f-3190-48a5-bed8-7d49836fe96f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.866035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] The token cache is being invalidate because project b41e11af95924026805e3a235cf985b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:53.866644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.867409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c47f569f-3190-48a5-bed8-7d49836fe96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:53.869549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 911/1828] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:53 2022] DELETE /identity/v3/projects/b41e11af95924026805e3a235cf985b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:00:53.877470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0cb02-0e67-42c8-b3a5-eaf1870ea8d2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:53.877668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee079aa-b512-4736-8690-9fb121b4697d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:53.878169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0cb02-0e67-42c8-b3a5-eaf1870ea8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:53.878634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0cb02-0e67-42c8-b3a5-eaf1870ea8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:53.906795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-00d0cb02-0e67-42c8-b3a5-eaf1870ea8d2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:53.908744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-00d0cb02-0e67-42c8-b3a5-eaf1870ea8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:54.007411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.008239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.008523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.008801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.010710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:54.019060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 912/1829] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:00:54.026201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.026831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.027143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.027428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.027945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.047699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 918/1830] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:54.057766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:54.059674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:54.068301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 913/1831] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:54.072309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.083460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ba713-2abc-4cb1-b7c4-e0e3d9ea27f7 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.089363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.089363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.089653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.089995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.090671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:54.090977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.092709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.107166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 919/1832] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:54.111288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.122484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c25400-b3e3-465a-9033-fd063e1026eb None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.128396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.129043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.129329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.129605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.130291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.132584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.182018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.182868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 914/1833] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:54 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:54.194101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7bb5f-2194-4e63-a497-4f699780e6df admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.273776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.274399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.274683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.275174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.275757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.277963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.312117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 920/1834] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:54 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:00:54.313037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.327824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b492e33-9685-4876-906b-cf41c694baef admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.340124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.340777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.341056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.341827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.342580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.344513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.363892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 915/1835] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:54.367335 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.378639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03581b65-839d-4d9f-bce8-6bdd352cae7b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.384962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44609a-2e9d-4262-bb50-b6d30553ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.385804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44609a-2e9d-4262-bb50-b6d30553ff75 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.386196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44609a-2e9d-4262-bb50-b6d30553ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.393092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44609a-2e9d-4262-bb50-b6d30553ff75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.394290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44609a-2e9d-4262-bb50-b6d30553ff75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.396804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44609a-2e9d-4262-bb50-b6d30553ff75 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.412148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 921/1836] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:54.418630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.432314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb939e0-666b-490f-9d73-c6dfe72955f6 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.439284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.440215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.440691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.441051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] PATH_INFO: `/v3/projects/325802f877e2429883d420cd6bd74c69/users/9df64f94c3b649c78acb179cc8a0e3da/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.478981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325802f877e2429883d420cd6bd74c69, user_id=9df64f94c3b649c78acb179cc8a0e3da, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.481925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.506473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 916/1837] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:54 2022] PUT /identity/v3/projects/325802f877e2429883d420cd6bd74c69/users/9df64f94c3b649c78acb179cc8a0e3da/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:54.517701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.518003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.518252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.548037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:54.566944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] MFA Rules not processed for user `9df64f94c3b649c78acb179cc8a0e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:54.570333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:54.690318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 922/1838] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:54.694828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.736824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:54.759330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.761698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:54.843980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ca47-a14e-4902-9411-f283f4fe3899 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.868465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.869132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.869453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.869826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.870647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.875140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.890997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad53a-374c-4655-ab66-bde665b95cd5 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:54.897244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:54.898131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:54.898507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:54.898841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] PATH_INFO: `/v3/projects/7a2c0b4619374f7abac51d49afba8c10` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:54.900520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2c0b4619374f7abac51d49afba8c10)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:54.903346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:54.916611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 917/1839] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:54 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:54.921954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:54.992486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2c0b4619374f7abac51d49afba8c10', 'request_id': 'req-18cc19b7-734a-4eff-9cca-9401668b51a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:54.999589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2c0b4619374f7abac51d49afba8c10', 'request_id': 'req-18cc19b7-734a-4eff-9cca-9401668b51a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.006683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2c0b4619374f7abac51d49afba8c10', 'request_id': 'req-18cc19b7-734a-4eff-9cca-9401668b51a4'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.023391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] The token cache is being invalidate because project 7a2c0b4619374f7abac51d49afba8c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:55.023878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.025470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.027695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 923/1840] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:54 2022] DELETE /identity/v3/projects/7a2c0b4619374f7abac51d49afba8c10 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:55.031440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.032989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:55.050860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54784-2efd-4a6b-8d94-734d0db4a644 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.077429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:55.134240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc19b7-734a-4eff-9cca-9401668b51a4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.160165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.161200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.161716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.162480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] PATH_INFO: `/v3/users/c3e5250d72ae414bbec424e8a7f6c3ed` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.165461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e5250d72ae414bbec424e8a7f6c3ed)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.168915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:55.183835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.184487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.184982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.185103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.185740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.187972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:55.238187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 918/1841] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:54 2022] POST /identity/v3/users => generated 291 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:55.238347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e5250d72ae414bbec424e8a7f6c3ed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.238347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e5250d72ae414bbec424e8a7f6c3ed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.240678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.245899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:55.252134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e5250d72ae414bbec424e8a7f6c3ed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.253040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e5250d72ae414bbec424e8a7f6c3ed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.266423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e5250d72ae414bbec424e8a7f6c3ed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:55.266764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29650-898c-4a35-880c-71ad0504f54c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.275520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.276471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.276802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.277116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.277868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.279813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:55.293001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 924/1842] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:55 2022] DELETE /identity/v3/users/c3e5250d72ae414bbec424e8a7f6c3ed => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:55.303789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 919/1843] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:55.308221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.309725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:55.440633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc746-72bd-4075-bee0-e16ec62b3843 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.450330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.451702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.452251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.452491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] PATH_INFO: `/v3/projects/87fce85402994f3a8e4636bfc652a390/users/246ed15b482049099a06e31fe62b20bf/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.492587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fce85402994f3a8e4636bfc652a390, user_id=246ed15b482049099a06e31fe62b20bf, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.495466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:55.517521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 925/1844] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:55 2022] PUT /identity/v3/projects/87fce85402994f3a8e4636bfc652a390/users/246ed15b482049099a06e31fe62b20bf/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:55.523183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.548681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911772b-4cbb-4b9e-b3dd-5632e621cabf admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.627386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:55.666162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c13c5-caea-4ca1-aee2-6ae92ffaefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.667124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c13c5-caea-4ca1-aee2-6ae92ffaefbd admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.667563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c13c5-caea-4ca1-aee2-6ae92ffaefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.667972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c13c5-caea-4ca1-aee2-6ae92ffaefbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.669079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c13c5-caea-4ca1-aee2-6ae92ffaefbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.671746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c13c5-caea-4ca1-aee2-6ae92ffaefbd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:55.688119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 920/1845] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:55.692509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.706162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bdd8f-c8ab-4f43-8d4e-680c237107ad admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.713703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.714802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.715301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.715805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] PATH_INFO: `/v3/projects/87fce85402994f3a8e4636bfc652a390/users/246ed15b482049099a06e31fe62b20bf/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.718639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fce85402994f3a8e4636bfc652a390, user_id=246ed15b482049099a06e31fe62b20bf, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.727208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:55.742506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 926/1846] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:55 2022] PUT /identity/v3/projects/87fce85402994f3a8e4636bfc652a390/users/246ed15b482049099a06e31fe62b20bf/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:55.752841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.753362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.753592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.786202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] MFA Rules not processed for user `246ed15b482049099a06e31fe62b20bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:55.787855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:55.855521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.857776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:55.893194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:55.899542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 921/1847] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:55.912971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:55.915072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:55.957669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e1f8-cdf2-49c8-8ff9-adc226c0e11a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:55.963959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:55.964753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:55.965171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:55.965520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] PATH_INFO: `/v3/projects/4e376a1e97454dfda4bbf559e2dc9b56` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:55.966751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e376a1e97454dfda4bbf559e2dc9b56)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:55.969725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:56.042273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d143-d237-4b57-83e1-231e1b9000d5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:56.051842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:56.052747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:56.053791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:56.055507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:56.083805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:56.090314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:56.112672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e376a1e97454dfda4bbf559e2dc9b56', 'request_id': 'req-32781fc7-8776-496e-8456-2c69ce04dab1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.125296 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 922/1848] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:56.127380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e376a1e97454dfda4bbf559e2dc9b56', 'request_id': 'req-32781fc7-8776-496e-8456-2c69ce04dab1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.138241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e376a1e97454dfda4bbf559e2dc9b56', 'request_id': 'req-32781fc7-8776-496e-8456-2c69ce04dab1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.157899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] The token cache is being invalidate because project 4e376a1e97454dfda4bbf559e2dc9b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:56.158484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.159661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.164187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 927/1849] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:55 2022] DELETE /identity/v3/projects/4e376a1e97454dfda4bbf559e2dc9b56 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:00:56.167273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:56.186319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5c3a-1a99-4910-876c-93244a94268a service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:56.205463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:56.208246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:56.343447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32781fc7-8776-496e-8456-2c69ce04dab1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:56.355510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:56.356158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:56.356432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:56.356702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:56.360790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:56.407559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:56.409492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:56.410172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:56.410474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] PATH_INFO: `/v3/users/01e9c4414a5e4577ac1aad75cab88d5e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:56.417184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e9c4414a5e4577ac1aad75cab88d5e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:56.423481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:56.436483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:56.487203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:56.489520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:56.518196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 928/1850] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:56.545138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e9c4414a5e4577ac1aad75cab88d5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.546241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e9c4414a5e4577ac1aad75cab88d5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.547192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e9c4414a5e4577ac1aad75cab88d5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.561673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e9c4414a5e4577ac1aad75cab88d5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.572216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dae451c0-6476-4a34-b487-52173f1b553a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e9c4414a5e4577ac1aad75cab88d5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:56.597127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 923/1851] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:00:56 2022] DELETE /identity/v3/users/01e9c4414a5e4577ac1aad75cab88d5e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:58.049878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:58.052276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:58.062570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:58.089998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ebdf-7086-4e8d-82c7-358821d9f38e service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:58.242285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:58.243234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.243815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.244233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] PATH_INFO: `/v3/projects/30d2fc3619d14001a825dabd897b38ad` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.248384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d2fc3619d14001a825dabd897b38ad)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:58.250438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:58.347269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d2fc3619d14001a825dabd897b38ad', 'request_id': 'req-98913180-fb19-4e40-822e-c3f4b5efeb4f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:58.362957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d2fc3619d14001a825dabd897b38ad', 'request_id': 'req-98913180-fb19-4e40-822e-c3f4b5efeb4f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:58.373772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d2fc3619d14001a825dabd897b38ad', 'request_id': 'req-98913180-fb19-4e40-822e-c3f4b5efeb4f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:58.404956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] The token cache is being invalidate because project 30d2fc3619d14001a825dabd897b38ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:00:58.405302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:58.406129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-98913180-fb19-4e40-822e-c3f4b5efeb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:00:58.408032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 929/1852] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:00:58 2022] DELETE /identity/v3/projects/30d2fc3619d14001a825dabd897b38ad => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:58.415745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.416320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.416320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.456623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:58.458875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:58.535496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 924/1853] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:58.544334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.544688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.546789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.573297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:58.577565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:58.596853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 930/1854] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:58.601432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:58.614927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56274450-dab9-4aef-bd3b-6642d5c5f491 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:58.634002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:58.635013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.635458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.635730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.639445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:00:58.639917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:58.641525 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:58.689987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 925/1855] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:00:58.691630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:58.708702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e5c85-8a92-4f6b-b7cf-5b1d218fb54e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:58.734564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:58.737399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.737704 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.737967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.739920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:58.753567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:58.807229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 931/1856] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:58 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:58.811411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:58.827596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b90c-fdfb-4c0f-9d18-31657ad02a4e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:58.918414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:58.919481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.919942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.920420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.921241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:58.923728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:58.948422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:58.965423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 926/1857] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:58 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:58.969486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:58.990547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98c093-d7a6-47f4-af3b-f022671beb08 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:58.996392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:58.997015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:58.997355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:58.997716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:58.998484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.000632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.017221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 932/1858] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:59.018021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.029452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36985e02-b080-40c5-9c3a-f951f7b1e937 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.035649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890000bf-460e-4bb6-91ea-a9ad6d957096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.036395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890000bf-460e-4bb6-91ea-a9ad6d957096 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.037268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890000bf-460e-4bb6-91ea-a9ad6d957096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.039109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890000bf-460e-4bb6-91ea-a9ad6d957096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.040065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890000bf-460e-4bb6-91ea-a9ad6d957096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.041596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890000bf-460e-4bb6-91ea-a9ad6d957096 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.056092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 927/1859] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:59.060610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.072963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82380-1e76-47ae-a9f8-6896e33e14d3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.078500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.079929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.080282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.080616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] PATH_INFO: `/v3/projects/ab18c3ca1b6a42738236e4254709aa90/users/28d7348b59e94f5b89e559a7fb14c874/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.100304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab18c3ca1b6a42738236e4254709aa90, user_id=28d7348b59e94f5b89e559a7fb14c874, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.104066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.139033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.139343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.139619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.142316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 933/1860] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:59 2022] PUT /identity/v3/projects/ab18c3ca1b6a42738236e4254709aa90/users/28d7348b59e94f5b89e559a7fb14c874/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:00:59.212153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] MFA Rules not processed for user `28d7348b59e94f5b89e559a7fb14c874`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:59.213648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:59.312487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.319323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 928/1861] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:59.354745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:59.398628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef3cc-e5fc-4261-ab30-56ce94865523 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.403701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.404594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.405092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.405463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.406201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.408533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.449465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 934/1862] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:59 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:59.454017 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.468638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a72b3-c152-4d67-8dda-d851f33a4e1d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.527707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.528957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.528957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.529169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.529714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.531679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.570895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 929/1863] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:59 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:00:59.571804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.595457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b00022-db70-4731-bb90-c1f4283ef2f6 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.600327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.601090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.601374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.601655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.602316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.603972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.615638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 935/1864] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:00:59.620066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.630238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9870c2-7d3a-4cf0-a7a6-16f84109c595 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.635038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf00f3-091b-4dc3-a111-cfd0ead15b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.635617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf00f3-091b-4dc3-a111-cfd0ead15b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.635899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf00f3-091b-4dc3-a111-cfd0ead15b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.636288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf00f3-091b-4dc3-a111-cfd0ead15b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.636940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf00f3-091b-4dc3-a111-cfd0ead15b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.638555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf00f3-091b-4dc3-a111-cfd0ead15b51 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.649240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 930/1865] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:00:59.653357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.663762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a059-c471-4b62-9ea8-4efbfdc41a26 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.668586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.669267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.669545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.669822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] PATH_INFO: `/v3/projects/24579d93a65a491fad4be14994db4077/users/9c83b857b1ba473b9133aea02ad8da5f/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.684626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24579d93a65a491fad4be14994db4077, user_id=9c83b857b1ba473b9133aea02ad8da5f, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.687311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.703759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 936/1866] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:00:59 2022] PUT /identity/v3/projects/24579d93a65a491fad4be14994db4077/users/9c83b857b1ba473b9133aea02ad8da5f/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:00:59.715484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.715775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.716052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.746258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] MFA Rules not processed for user `9c83b857b1ba473b9133aea02ad8da5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:00:59.747576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:59.800823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:59.831686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 931/1867] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:00:59.836401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.912972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a8f0-637d-482e-82bf-bda720580de4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:59.918607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:59.919377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:59.919562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:59.919836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:59.920477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:59.922400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:59.959818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 937/1868] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:00:59 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:00:59.963427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:59.977887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a359-9c4c-4233-bdfe-cf697c177c63 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.042250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.042874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.043185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.043459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.044102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.046084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.076922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 932/1869] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:00:59 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:00.081081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:00.093663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e22c83-f37c-481d-b361-be3041082d3d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.099096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.100252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.100680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.101157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.101981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.104007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.118851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 938/1870] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:00.123020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:00.139680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee82569-70af-4b3e-8ee0-c527c1adff5d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.148056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.149079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.149581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.150059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] PATH_INFO: `/v3/projects/869771f33a2a4028af58d5d64c8d63ce/users/fb808ff0ec3d4009adad41ae07d64f7b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.179025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869771f33a2a4028af58d5d64c8d63ce, user_id=fb808ff0ec3d4009adad41ae07d64f7b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.183076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.214616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 933/1871] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:00 2022] PUT /identity/v3/projects/869771f33a2a4028af58d5d64c8d63ce/users/fb808ff0ec3d4009adad41ae07d64f7b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:00.224587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:00.247700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a882c9-1a32-47b3-b681-06c7730d13b8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.323914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:00.339546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f65c1-8dd5-48a8-8b5e-319daf88d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.340252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f65c1-8dd5-48a8-8b5e-319daf88d96a admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.343165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f65c1-8dd5-48a8-8b5e-319daf88d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.343465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f65c1-8dd5-48a8-8b5e-319daf88d96a admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.344371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f65c1-8dd5-48a8-8b5e-319daf88d96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.346160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f65c1-8dd5-48a8-8b5e-319daf88d96a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.358883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 939/1872] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:00.363385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:00.377967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13a94-7c26-4750-b9d5-2a90f11f8221 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.384791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.385999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.386444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.386873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] PATH_INFO: `/v3/projects/869771f33a2a4028af58d5d64c8d63ce/users/fb808ff0ec3d4009adad41ae07d64f7b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.389236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869771f33a2a4028af58d5d64c8d63ce, user_id=fb808ff0ec3d4009adad41ae07d64f7b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.393595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.409964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 934/1873] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:00 2022] PUT /identity/v3/projects/869771f33a2a4028af58d5d64c8d63ce/users/fb808ff0ec3d4009adad41ae07d64f7b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:00.421097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8042e2-b79e-449a-8479-0ccef9c1d3fb None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.421381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8042e2-b79e-449a-8479-0ccef9c1d3fb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.422578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8042e2-b79e-449a-8479-0ccef9c1d3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.500008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ea8042e2-b79e-449a-8479-0ccef9c1d3fb None None] MFA Rules not processed for user `fb808ff0ec3d4009adad41ae07d64f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:00.501878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ea8042e2-b79e-449a-8479-0ccef9c1d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:00.627349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:00.629470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:00.693180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 940/1874] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:00.697699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bee9d6-5279-4b09-ba5f-f1b565489abd None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.697699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bee9d6-5279-4b09-ba5f-f1b565489abd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.697699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bee9d6-5279-4b09-ba5f-f1b565489abd None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.698254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 941/1875] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:01:00.708002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bee9d6-5279-4b09-ba5f-f1b565489abd None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:00.710710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d9bee9d6-5279-4b09-ba5f-f1b565489abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:00.807178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a315d-8f2d-4343-9e83-13a6bc5344b3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.813103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bee9d6-5279-4b09-ba5f-f1b565489abd None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:00.815805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.816579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.816862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.817170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] PATH_INFO: `/v3/users/9df64f94c3b649c78acb179cc8a0e3da` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.818486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df64f94c3b649c78acb179cc8a0e3da)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.820527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.828231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda93ef-1334-4e4d-a7d8-0dd88056d83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:00.828878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda93ef-1334-4e4d-a7d8-0dd88056d83f service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.829159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda93ef-1334-4e4d-a7d8-0dd88056d83f service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.829433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda93ef-1334-4e4d-a7d8-0dd88056d83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:00.911773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:00.919860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df64f94c3b649c78acb179cc8a0e3da'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:00.921135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df64f94c3b649c78acb179cc8a0e3da'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:00.922178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df64f94c3b649c78acb179cc8a0e3da'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:00.930855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda93ef-1334-4e4d-a7d8-0dd88056d83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:00.932972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda93ef-1334-4e4d-a7d8-0dd88056d83f service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:00.938069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df64f94c3b649c78acb179cc8a0e3da'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:00.950317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97b5a0ee-ea41-463f-8b49-30b49c16fae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df64f94c3b649c78acb179cc8a0e3da'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:00.974878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 942/1876] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:00.986201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:00.989828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:00.992159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:01.007478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 935/1877] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:00 2022] DELETE /identity/v3/users/9df64f94c3b649c78acb179cc8a0e3da => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:01.010449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:01.010747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:01.011024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:01.049124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:01.052755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:01.055435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:01.057836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:01.112356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:01.157425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 936/1878] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:01.190669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:01.192528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:01.231104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 943/1879] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:01:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:01.246194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:01.250109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:01.301384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd772d1-a002-4838-90ff-fdd8d05c49ce None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:01.324777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:01.331840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:01.332769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:01.334139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:01.364731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:01.369953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e68445-5eb3-4ef6-968b-59971e9f66ed None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:01.376573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:01.376736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:01.377490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:01.377847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:01.378188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:01.407488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:01.407488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:01.441898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 937/1880] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:01.448027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 944/1881] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:02.880649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:02.882899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:02.897650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a8778-5180-43f4-a339-80df23ac1aa2 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:02.902293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:02.903226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:02.903720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:02.904253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] PATH_INFO: `/v3/projects/325802f877e2429883d420cd6bd74c69` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:02.905612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=325802f877e2429883d420cd6bd74c69)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:02.907771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:02.974069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325802f877e2429883d420cd6bd74c69', 'request_id': 'req-da4a3923-0e6e-40be-a3c6-181accb7b95b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:02.983733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325802f877e2429883d420cd6bd74c69', 'request_id': 'req-da4a3923-0e6e-40be-a3c6-181accb7b95b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:02.991452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:03.011121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325802f877e2429883d420cd6bd74c69', 'request_id': 'req-da4a3923-0e6e-40be-a3c6-181accb7b95b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.034814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] The token cache is being invalidate because project 325802f877e2429883d420cd6bd74c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:03.035303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.036163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.043625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 938/1882] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:02 2022] DELETE /identity/v3/projects/325802f877e2429883d420cd6bd74c69 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:03.047701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:03.081480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:03.083343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:03.085915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d594-4966-422c-ac19-346bdf6c9297 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:03.175508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3923-0e6e-40be-a3c6-181accb7b95b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:03.181677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:03.182488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:03.182862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:03.183238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:03.185403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:03.234446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:03.235397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:03.236302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:03.237151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] PATH_INFO: `/v3/users/246ed15b482049099a06e31fe62b20bf` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:03.238169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] RBAC: Authorizing `identity:delete_user(user_id=246ed15b482049099a06e31fe62b20bf)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:03.240767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:03.288387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:03.290556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:03.322885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 939/1883] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:03.336508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246ed15b482049099a06e31fe62b20bf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.340597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246ed15b482049099a06e31fe62b20bf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.359955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246ed15b482049099a06e31fe62b20bf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.360935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246ed15b482049099a06e31fe62b20bf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.372874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6697d125-3e41-49e5-a633-419c4966578c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246ed15b482049099a06e31fe62b20bf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:03.415479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 945/1884] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:03 2022] DELETE /identity/v3/users/246ed15b482049099a06e31fe62b20bf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:03.937585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:03.939075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:03.955287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09d27d-8b71-4ecd-8fec-faf7362fea63 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.018477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.019165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.019452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.019725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] PATH_INFO: `/v3/projects/87fce85402994f3a8e4636bfc652a390` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.021096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fce85402994f3a8e4636bfc652a390)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.023600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.071496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:04.079970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fce85402994f3a8e4636bfc652a390', 'request_id': 'req-fa9c7a54-8197-4cbc-a385-69bd1764fa44'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:04.088045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fce85402994f3a8e4636bfc652a390', 'request_id': 'req-fa9c7a54-8197-4cbc-a385-69bd1764fa44'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:04.095385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fce85402994f3a8e4636bfc652a390', 'request_id': 'req-fa9c7a54-8197-4cbc-a385-69bd1764fa44'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:04.109967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] The token cache is being invalidate because project 87fce85402994f3a8e4636bfc652a390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:04.110315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:04.110878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fa9c7a54-8197-4cbc-a385-69bd1764fa44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:04.112569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 940/1885] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:03 2022] DELETE /identity/v3/projects/87fce85402994f3a8e4636bfc652a390 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:04.117513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.117968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.118043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.138455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:04.140848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:04.178928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:04.229087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 946/1886] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:04.236776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.237068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.237340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.262014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:04.263436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:04.273006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 941/1887] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:04.284987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.301407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e77df8-b66e-4841-a56c-1ba7acca4ea9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.307168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.307895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.308214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.308609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.309907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:04.310220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.324619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.325398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 947/1888] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:04.326425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.328347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:04.329564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.340847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe79b-e5ce-40e8-8df7-d70a3318941f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.345717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.346542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.346885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.347248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.347950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.350325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.387873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 948/1889] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:04.391554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dc769-4fa0-472d-b18a-38c31842477e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.392186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.446471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.447256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.447598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.447934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.449930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:04.464731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a072095-9e38-4adc-8c73-81b3ade9589a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.469456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.470097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.470381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.470656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.472904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.474901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.509472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 949/1890] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:04.510770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.522339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc73e-b1cf-4811-bf8b-d23d6583d2ca admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.527285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.527860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.528137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.528415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.529723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.533460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.549464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 950/1891] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:04.553628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.565607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fe6bc-662d-416c-832d-5289222513ee admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.571974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fdae2-0261-4312-ac68-004006471a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.572816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fdae2-0261-4312-ac68-004006471a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.572975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fdae2-0261-4312-ac68-004006471a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.573240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fdae2-0261-4312-ac68-004006471a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.573891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fdae2-0261-4312-ac68-004006471a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.574863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.575584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fdae2-0261-4312-ac68-004006471a2d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.576347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.587515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 942/1892] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:04.590039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 951/1893] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:01:04.594146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.607723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e178c0-a43f-4c4e-9b19-358c08c73351 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.613145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.613853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.614140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.614419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] PATH_INFO: `/v3/projects/65d1a3052e3a485b983a3e4b170ffb3c/users/fe88bd77523b4f44b2705177870938c4/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.636615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d1a3052e3a485b983a3e4b170ffb3c, user_id=fe88bd77523b4f44b2705177870938c4, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.640053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.670855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 943/1894] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:04 2022] PUT /identity/v3/projects/65d1a3052e3a485b983a3e4b170ffb3c/users/fe88bd77523b4f44b2705177870938c4/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:04.683825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.684266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.684524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.727703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] MFA Rules not processed for user `fe88bd77523b4f44b2705177870938c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:04.729029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:04.777507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:04.800091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 952/1895] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:04.804745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.812128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:04.892639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9417b-fdea-416d-a7b0-f29f7e379f7c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:04.898759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:04.899484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:04.899826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:04.900167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:04.900882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:04.903211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:04.948152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:04.950664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 944/1896] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:04.961339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b7e7-cdb6-4341-86c4-750666fcdf34 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.116342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.117103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.117381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.117637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.120162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.122603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.174396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 953/1897] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:04 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:05.176001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.227608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16f2e-24c6-4346-8a6a-4fa128bccab2 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.236629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.238013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.240829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.240829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.241080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.243148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.259550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 945/1898] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:05.263880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.274769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da9dd0-64b6-4cb1-aaef-a7402ec08469 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.280484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945ec8-266b-4e72-ac90-6f69d3aa582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.281403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945ec8-266b-4e72-ac90-6f69d3aa582b admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.281869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945ec8-266b-4e72-ac90-6f69d3aa582b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.282387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945ec8-266b-4e72-ac90-6f69d3aa582b admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.283235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e945ec8-266b-4e72-ac90-6f69d3aa582b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.284907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e945ec8-266b-4e72-ac90-6f69d3aa582b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.296633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 954/1899] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:05.301475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.312044 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473cd43-4b99-4f04-b2e7-2c2c9bdc9eec admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.316865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.317537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.317826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.318084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] PATH_INFO: `/v3/projects/4f000088be5a434b85ceb259dd089020/users/e22d9b3d323349c0bdf8572860223744/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.336736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f000088be5a434b85ceb259dd089020, user_id=e22d9b3d323349c0bdf8572860223744, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.339503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.362040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 946/1900] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:05 2022] PUT /identity/v3/projects/4f000088be5a434b85ceb259dd089020/users/e22d9b3d323349c0bdf8572860223744/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:05.373346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.373631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.373910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.413387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] MFA Rules not processed for user `e22d9b3d323349c0bdf8572860223744`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:05.415369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:05.513767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 955/1901] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:05.514024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.614968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c986c07-cca4-4537-b14a-fe66254a6736 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.620469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.621232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.621532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.621779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.622417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.624364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.657524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 947/1902] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:05 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:05.661030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.672198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3c1d8-dad2-486d-93e8-0bb84696e056 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.748950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:05.758015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.758015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.758015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.758542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.759295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.761672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.788546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 956/1903] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:05 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:05.789768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.801857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24a10-2a5e-424f-a74b-5b6d895f4cf7 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.808202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.809050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.809513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.809965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.810792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.812629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.824499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 948/1904] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:01:05.829060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.841497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da1e89-4dd4-4dbe-992c-fc62d51ef2dd admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.846401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.847268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.847528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.847802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] PATH_INFO: `/v3/projects/cfff07c4eef94c89a80c018cfad2a585/users/350e03b2cd664103b44d978060673089/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.865448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfff07c4eef94c89a80c018cfad2a585, user_id=350e03b2cd664103b44d978060673089, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.868530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.888172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 957/1905] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:05 2022] PUT /identity/v3/projects/cfff07c4eef94c89a80c018cfad2a585/users/350e03b2cd664103b44d978060673089/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:05.892291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.902450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6f9f-c650-4d91-a374-44227590c1a1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.929811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:05.963677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f827d-db6d-42b2-b9d0-276d1125d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.964416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f827d-db6d-42b2-b9d0-276d1125d714 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.964568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f827d-db6d-42b2-b9d0-276d1125d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.964840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f827d-db6d-42b2-b9d0-276d1125d714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.965495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f827d-db6d-42b2-b9d0-276d1125d714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.967159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f827d-db6d-42b2-b9d0-276d1125d714 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.980902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 949/1906] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:05.982292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.995290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c09e-deb6-4174-822f-d12ff86b4c64 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.999911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.000580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.000858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.001133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] PATH_INFO: `/v3/projects/cfff07c4eef94c89a80c018cfad2a585/users/350e03b2cd664103b44d978060673089/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.003754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfff07c4eef94c89a80c018cfad2a585, user_id=350e03b2cd664103b44d978060673089, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.007301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.020877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 958/1907] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:05 2022] PUT /identity/v3/projects/cfff07c4eef94c89a80c018cfad2a585/users/350e03b2cd664103b44d978060673089/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:06.032921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.033213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.033485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.079154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] MFA Rules not processed for user `350e03b2cd664103b44d978060673089`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:06.081373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:06.170846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 950/1908] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:06.184628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.278877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186b62-442c-40dd-92fe-cb9081d05000 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.283109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.283729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.284005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.284273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.299192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.301078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.312235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 959/1909] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:06.973422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.975027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:06.987703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5752b9-1817-417c-bd49-e1cf52fa01ca None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.991377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d585c3-dd44-434a-8954-95d54023d0e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.992053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d585c3-dd44-434a-8954-95d54023d0e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.992329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d585c3-dd44-434a-8954-95d54023d0e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.992752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d585c3-dd44-434a-8954-95d54023d0e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.052311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d585c3-dd44-434a-8954-95d54023d0e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.056474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d585c3-dd44-434a-8954-95d54023d0e2 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:07.069963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 951/1910] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:08.791800 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:08.793471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:08.926605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26417c9-370d-4fe7-974b-dab43008b541 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:08.934667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:08.936079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:08.936754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:08.937315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] PATH_INFO: `/v3/users/28d7348b59e94f5b89e559a7fb14c874` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:08.939112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d7348b59e94f5b89e559a7fb14c874)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:08.942071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:09.031557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d7348b59e94f5b89e559a7fb14c874'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.033090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d7348b59e94f5b89e559a7fb14c874'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.052331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d7348b59e94f5b89e559a7fb14c874'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.053254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d7348b59e94f5b89e559a7fb14c874'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.055373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:09.064263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d7348b59e94f5b89e559a7fb14c874'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.095006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 960/1911] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:08 2022] DELETE /identity/v3/users/28d7348b59e94f5b89e559a7fb14c874 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:09.099564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:09.100576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:09.100576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:09.122972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:09.124220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:09.191972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:09.221045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 952/1912] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:09.231568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:09.232986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:09.309067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cbf4d-db72-4b84-badf-bce2b42ebd74 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:09.316698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:09.318305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:09.319423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:09.321809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:09.348640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:09.350605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:09.376946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 961/1913] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:09.863431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:09.865203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:09.896757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6bb26-c2a5-4abe-a39b-3f421355a693 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:09.904860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:09.906260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:09.906623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:09.907174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] PATH_INFO: `/v3/projects/ab18c3ca1b6a42738236e4254709aa90` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:09.910339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab18c3ca1b6a42738236e4254709aa90)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:09.912771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:09.995248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab18c3ca1b6a42738236e4254709aa90', 'request_id': 'req-b7513bbc-3751-41a7-8e07-e7bfb37562ac'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.004836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab18c3ca1b6a42738236e4254709aa90', 'request_id': 'req-b7513bbc-3751-41a7-8e07-e7bfb37562ac'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.015125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab18c3ca1b6a42738236e4254709aa90', 'request_id': 'req-b7513bbc-3751-41a7-8e07-e7bfb37562ac'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.037742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] The token cache is being invalidate because project ab18c3ca1b6a42738236e4254709aa90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:10.039332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.041790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.047414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 953/1914] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:09 2022] DELETE /identity/v3/projects/ab18c3ca1b6a42738236e4254709aa90 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:10.054275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.068285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112dd1-9404-4939-917f-2ce9d7e3a8aa service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.164619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.165730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.166171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.166896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] PATH_INFO: `/v3/users/9c83b857b1ba473b9133aea02ad8da5f` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.168678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c83b857b1ba473b9133aea02ad8da5f)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.170821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:10.239189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c83b857b1ba473b9133aea02ad8da5f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.239855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c83b857b1ba473b9133aea02ad8da5f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.250132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c83b857b1ba473b9133aea02ad8da5f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.253076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c83b857b1ba473b9133aea02ad8da5f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.263267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c83b857b1ba473b9133aea02ad8da5f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.278557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:10.288566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 962/1915] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:10 2022] DELETE /identity/v3/users/9c83b857b1ba473b9133aea02ad8da5f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:10.782363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.783940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:10.806009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7513bbc-3751-41a7-8e07-e7bfb37562ac admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.942302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.944530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:10.952005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.953283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.953710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.954133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] PATH_INFO: `/v3/projects/24579d93a65a491fad4be14994db4077` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.955919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24579d93a65a491fad4be14994db4077)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.959482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.030369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24579d93a65a491fad4be14994db4077', 'request_id': 'req-9ac7acc0-9135-418f-8863-6b0b97430111'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.048501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24579d93a65a491fad4be14994db4077', 'request_id': 'req-9ac7acc0-9135-418f-8863-6b0b97430111'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.070535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24579d93a65a491fad4be14994db4077', 'request_id': 'req-9ac7acc0-9135-418f-8863-6b0b97430111'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.072907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda1848-33f7-4f44-a34e-872eb9235a0b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.090611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] The token cache is being invalidate because project 24579d93a65a491fad4be14994db4077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:11.091184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.091958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.094580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 954/1916] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:10 2022] DELETE /identity/v3/projects/24579d93a65a491fad4be14994db4077 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:11.098326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.103085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.108595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:11.171193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.171978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.172323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.172662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] PATH_INFO: `/v3/users/410f490f00bf49a7b86d6eafbe5d3f56` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.174514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410f490f00bf49a7b86d6eafbe5d3f56)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.177330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.208502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7acc0-9135-418f-8863-6b0b97430111 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.214319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.215161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.215263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.215526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] PATH_INFO: `/v3/users/fb808ff0ec3d4009adad41ae07d64f7b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.216702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb808ff0ec3d4009adad41ae07d64f7b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.219156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.261050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410f490f00bf49a7b86d6eafbe5d3f56'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.262359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410f490f00bf49a7b86d6eafbe5d3f56'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.275136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410f490f00bf49a7b86d6eafbe5d3f56'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.276808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410f490f00bf49a7b86d6eafbe5d3f56'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.287444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-57655280-1f9e-4d15-bd37-35532fca9676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410f490f00bf49a7b86d6eafbe5d3f56'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.306043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb808ff0ec3d4009adad41ae07d64f7b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.306739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb808ff0ec3d4009adad41ae07d64f7b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.307383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb808ff0ec3d4009adad41ae07d64f7b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.319902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb808ff0ec3d4009adad41ae07d64f7b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.333314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb808ff0ec3d4009adad41ae07d64f7b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:11.337146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 963/1917] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:10 2022] DELETE /identity/v3/users/410f490f00bf49a7b86d6eafbe5d3f56 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:11.338675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.338970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.339278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.363646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 955/1918] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:11 2022] DELETE /identity/v3/users/fb808ff0ec3d4009adad41ae07d64f7b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:11.388062 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.392486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.446379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:11.599297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.602223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.625500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 964/1919] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:11.626928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.633097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.754224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76144fa-f79c-403f-b160-dd04d6cb6cd8 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.759174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.759837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.760114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.761051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.764910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546499c5-e293-4683-9ea3-e0be8081725f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.768816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.769586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.769967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.770317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.771299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.772325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.773531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.787466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 956/1920] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:11.851944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.853651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.865474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 965/1921] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:12.121142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.124063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.141125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b935f5-32b9-4058-ac71-bd1c29c1ef4a service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.146215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.147941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.148247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.148546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] PATH_INFO: `/v3/projects/869771f33a2a4028af58d5d64c8d63ce` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.158303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] RBAC: Authorizing `identity:delete_project(project_id=869771f33a2a4028af58d5d64c8d63ce)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.160629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.188967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:12.244503 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869771f33a2a4028af58d5d64c8d63ce', 'request_id': 'req-5794b24d-3165-4bb7-8762-95d50df3840e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.257573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869771f33a2a4028af58d5d64c8d63ce', 'request_id': 'req-5794b24d-3165-4bb7-8762-95d50df3840e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.259915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.261491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.270724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869771f33a2a4028af58d5d64c8d63ce', 'request_id': 'req-5794b24d-3165-4bb7-8762-95d50df3840e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.278873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493946f-c83d-453f-943f-986d54f80d9c service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.289190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] The token cache is being invalidate because project 869771f33a2a4028af58d5d64c8d63ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:12.289483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.290129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5794b24d-3165-4bb7-8762-95d50df3840e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.295376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 957/1922] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:12 2022] DELETE /identity/v3/projects/869771f33a2a4028af58d5d64c8d63ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:12.297028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfbbb-8337-4442-b804-6a6bbb8158c0 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.297476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfbbb-8337-4442-b804-6a6bbb8158c0 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.297919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bfbbb-8337-4442-b804-6a6bbb8158c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.325536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c91bfbbb-8337-4442-b804-6a6bbb8158c0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:12.327016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c91bfbbb-8337-4442-b804-6a6bbb8158c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.357090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.357828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.358119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.358395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] PATH_INFO: `/v3/projects/d04f93a333854238a61673744de761a3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.359603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04f93a333854238a61673744de761a3)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.361606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.379239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:12.398357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 958/1923] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:12.407080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.407378 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.407647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.415296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04f93a333854238a61673744de761a3', 'request_id': 'req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.423229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04f93a333854238a61673744de761a3', 'request_id': 'req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.429666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:12.431198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.432358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04f93a333854238a61673744de761a3', 'request_id': 'req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.448876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] The token cache is being invalidate because project d04f93a333854238a61673744de761a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:12.449389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.450095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.451745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 966/1924] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:12 2022] DELETE /identity/v3/projects/d04f93a333854238a61673744de761a3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:12.457107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.458809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.502726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 959/1925] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:12.514474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.525308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09137d19-a70d-4f0a-8d03-ce573894b655 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.531010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.531664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.531952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.532227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.533528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:12.533864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.535604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.555132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f1bf-3561-4a7c-89b7-3bc4a988be5c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.559226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 960/1926] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:12.560683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.567036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.568479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.569358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.571187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] PATH_INFO: `/v3/users/3810c48dee49496d8cdab9bdc0f4a580` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.573032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3810c48dee49496d8cdab9bdc0f4a580)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.579246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.587638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2afcc-272d-4fbc-acc4-5480a6a60dd5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.610218 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.610835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.613500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.614966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.615906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.622029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.667602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3810c48dee49496d8cdab9bdc0f4a580'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.668715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3810c48dee49496d8cdab9bdc0f4a580'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.694403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3810c48dee49496d8cdab9bdc0f4a580'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.695242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3810c48dee49496d8cdab9bdc0f4a580'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.706525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3810c48dee49496d8cdab9bdc0f4a580'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:12.707471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 961/1927] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:12 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:12.708355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.710531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:12.725379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:12.765455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 967/1928] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:12 2022] DELETE /identity/v3/users/3810c48dee49496d8cdab9bdc0f4a580 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:12.802865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba7cc2-97f1-4a37-988a-cb35a1951686 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.894743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.895457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.895729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.896045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.896757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.898921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.926287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 962/1929] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:12 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:12.927528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.938195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a70ced-a5cf-421b-b831-058ec9287bf4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.962809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:12.963482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:12.963822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:12.964043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.964706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.966341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.980569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 968/1930] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:12.981941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:12.993806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e6279-5081-469d-aea6-154348c4c843 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:12.999710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.000329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.000607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.001012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.001789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.003470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.015299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 963/1931] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:13.019591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.030520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790db39a-8f9c-42a0-b5d7-fa7402f1b476 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.035399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b41189-4787-42a1-bf3a-9247a3b60c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.036052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41189-4787-42a1-bf3a-9247a3b60c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.036353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41189-4787-42a1-bf3a-9247a3b60c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.036636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41189-4787-42a1-bf3a-9247a3b60c9f admin admin] PATH_INFO: `/v3/projects/1226d31c51b840e997eefd767e1e3c39/users/f21f96019e8e4143ab21d0aadacd7014/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.048598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:13.052677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b41189-4787-42a1-bf3a-9247a3b60c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1226d31c51b840e997eefd767e1e3c39, user_id=f21f96019e8e4143ab21d0aadacd7014, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.056221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b41189-4787-42a1-bf3a-9247a3b60c9f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.079594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 969/1932] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:13 2022] PUT /identity/v3/projects/1226d31c51b840e997eefd767e1e3c39/users/f21f96019e8e4143ab21d0aadacd7014/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:13.090105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.090740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.091160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.091529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.092140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:13.107819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f0770-7c9c-48f3-8160-8a2b0def1442 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.137398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] MFA Rules not processed for user `f21f96019e8e4143ab21d0aadacd7014`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:13.139073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:13.184954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.185703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.185984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.186269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] PATH_INFO: `/v3/projects/8d27501ff1ec4a498449b5d2dd6ac18d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.187584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d27501ff1ec4a498449b5d2dd6ac18d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.189900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.234073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 970/1933] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:13.247147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.250838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:13.263134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:13.283757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d27501ff1ec4a498449b5d2dd6ac18d', 'request_id': 'req-1ff78c3b-4fc3-4828-9cad-58c4469db06f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:13.293703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d27501ff1ec4a498449b5d2dd6ac18d', 'request_id': 'req-1ff78c3b-4fc3-4828-9cad-58c4469db06f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:13.300421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d27501ff1ec4a498449b5d2dd6ac18d', 'request_id': 'req-1ff78c3b-4fc3-4828-9cad-58c4469db06f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:13.320533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] The token cache is being invalidate because project 8d27501ff1ec4a498449b5d2dd6ac18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:13.320888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:13.321654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1ff78c3b-4fc3-4828-9cad-58c4469db06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:13.329939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 964/1934] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:13 2022] DELETE /identity/v3/projects/8d27501ff1ec4a498449b5d2dd6ac18d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:13.331830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62788433-ef56-4216-8f3b-f8ee0affafe0 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.332131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62788433-ef56-4216-8f3b-f8ee0affafe0 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.332655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62788433-ef56-4216-8f3b-f8ee0affafe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.360209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35843364-d249-43f5-9ede-61a9f05b59cc None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.387547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-62788433-ef56-4216-8f3b-f8ee0affafe0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:13.389006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-62788433-ef56-4216-8f3b-f8ee0affafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:13.468262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.468948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.469226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.469494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.471340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:13.500954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 965/1935] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:13.510321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.510610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.510888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.518069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:13.535251 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:13.536593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:13.546923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 966/1936] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:13.551590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.562341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb25fb-0eca-45d6-9b08-2785ab3e5487 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.563927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.565553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.575013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.575787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.576069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.576339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.577204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:13.577841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.579625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.583086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 971/1937] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:13.595093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 967/1938] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:13.599430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.611917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4e9d2-07b9-4a61-b1cd-b41f27d61b20 service glance] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.617171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.617853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.618205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.618589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.619321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.621349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.660306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 972/1939] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:13 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:13.661751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.676318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225dc4-d18c-43ae-a64f-6475c6e1e010 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.775113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.785279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.785660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.786030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.786885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.789075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.813505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 968/1940] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:13 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:13.817689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.833614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc280-06df-4b08-be86-afbc24fc0cdc admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.840714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.841652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.842035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.842674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.843599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.846008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.871106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 973/1941] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:13.875201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.887506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d532e-56e7-4d25-ac14-dbe2f21deded admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.893407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915b62c-5160-4863-9f7c-59a05c285e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.894016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b62c-5160-4863-9f7c-59a05c285e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.895103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b62c-5160-4863-9f7c-59a05c285e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.895103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b62c-5160-4863-9f7c-59a05c285e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.895991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915b62c-5160-4863-9f7c-59a05c285e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.897726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915b62c-5160-4863-9f7c-59a05c285e22 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.912914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 969/1942] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:13.914318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:13.926298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc7ed3-b986-4a2e-b4ed-e350be8b49c9 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:13.938798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:13.939530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:13.939949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:13.940382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] PATH_INFO: `/v3/projects/468f175d0443411f92746e91d06e920f/users/a92374c8a8be4511808e2a1822b73478/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:13.962630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468f175d0443411f92746e91d06e920f, user_id=a92374c8a8be4511808e2a1822b73478, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:13.965332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:13.989590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 974/1943] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:13 2022] PUT /identity/v3/projects/468f175d0443411f92746e91d06e920f/users/a92374c8a8be4511808e2a1822b73478/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:14.000482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.000767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.001053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.030754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] MFA Rules not processed for user `a92374c8a8be4511808e2a1822b73478`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:14.032099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.057773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:14.114765 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 970/1944] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:14.120131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.205074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4be3-fe13-49f2-baf4-37f163a7e6e8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.209897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.210614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.210893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.211247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.211884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.213849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.247204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 975/1945] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:14 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:14.250432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.267514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768e1e-63ce-44e7-ac38-cdb6f64c1618 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.330191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.330730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.330984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.331281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.332060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.334241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.357173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 971/1946] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:14 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:14.361711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.373165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9cdc-ec69-4156-97e3-5b8f4ad9d383 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.379043 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.379685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.379971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.380242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.380929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.382619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.394583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 976/1947] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:14.403140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.414113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145c9f9-dff3-4b36-a183-1af1b539c565 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.419115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.419843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.420119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.420390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] PATH_INFO: `/v3/projects/a7b97cc90a364a02854a25c266535eb0/users/56fc1a9fc063416484723421a4757e34/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.436911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b97cc90a364a02854a25c266535eb0, user_id=56fc1a9fc063416484723421a4757e34, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.442134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.460919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 972/1948] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:14 2022] PUT /identity/v3/projects/a7b97cc90a364a02854a25c266535eb0/users/56fc1a9fc063416484723421a4757e34/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:14.464982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.470593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.472487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.477840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2934dc-8903-4939-a47c-a006a1311615 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.529742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:14.559142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.560324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.560906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.561259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.562011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.564261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.571989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7443c7-e34d-49b2-b9dc-935ed87cc8fe admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.578904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 977/1949] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:14.582987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.583305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.583626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.583902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.584173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] PATH_INFO: `/v3/users/fe88bd77523b4f44b2705177870938c4` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.585659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe88bd77523b4f44b2705177870938c4)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.589315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.595116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52ce92-1020-4834-80fd-750c44f36418 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.600185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903efc99-2335-4412-bccf-6ef45808bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.601767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903efc99-2335-4412-bccf-6ef45808bc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.602139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903efc99-2335-4412-bccf-6ef45808bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.602721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903efc99-2335-4412-bccf-6ef45808bc68 admin admin] PATH_INFO: `/v3/projects/a7b97cc90a364a02854a25c266535eb0/users/56fc1a9fc063416484723421a4757e34/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.604578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903efc99-2335-4412-bccf-6ef45808bc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b97cc90a364a02854a25c266535eb0, user_id=56fc1a9fc063416484723421a4757e34, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.607502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903efc99-2335-4412-bccf-6ef45808bc68 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.620134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 978/1950] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:14 2022] PUT /identity/v3/projects/a7b97cc90a364a02854a25c266535eb0/users/56fc1a9fc063416484723421a4757e34/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:14.625820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:14.632052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.632466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.632916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.659613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe88bd77523b4f44b2705177870938c4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.660376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe88bd77523b4f44b2705177870938c4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.661010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe88bd77523b4f44b2705177870938c4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.670977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe88bd77523b4f44b2705177870938c4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.671762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] MFA Rules not processed for user `56fc1a9fc063416484723421a4757e34`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:14.672989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.687471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49ec4c0d-f19d-4569-9ce0-8827c4cb2f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe88bd77523b4f44b2705177870938c4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.706576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 973/1951] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:14 2022] DELETE /identity/v3/users/fe88bd77523b4f44b2705177870938c4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:14.711571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.711861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.712654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.734364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:14.735852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.756027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 979/1952] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:14.772227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.780117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.821413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 974/1953] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:14.839279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.839279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.869244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54477b-e5d9-495b-8bb9-6538cfe25ce3 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.904559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309b35-5c6d-461c-84b3-c77b5fdb5791 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.908511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.909224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.909627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.910011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.920341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.921934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.922568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.923215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.923498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.923773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.925538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.933459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 975/1954] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:14.956545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:15.006240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.009805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:15.024582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 980/1955] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:15.443003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:15.447604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:15.474320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78a31a-29a8-4b4f-9f7e-4f093d595af0 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:15.487386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:15.488075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:15.488358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:15.488722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] PATH_INFO: `/v3/projects/65d1a3052e3a485b983a3e4b170ffb3c` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:15.490397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d1a3052e3a485b983a3e4b170ffb3c)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.493509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:15.550050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:15.558471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d1a3052e3a485b983a3e4b170ffb3c', 'request_id': 'req-1e517271-cc99-40f7-9b2c-c30e2101d892'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.566431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d1a3052e3a485b983a3e4b170ffb3c', 'request_id': 'req-1e517271-cc99-40f7-9b2c-c30e2101d892'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.573691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d1a3052e3a485b983a3e4b170ffb3c', 'request_id': 'req-1e517271-cc99-40f7-9b2c-c30e2101d892'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.589238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] The token cache is being invalidate because project 65d1a3052e3a485b983a3e4b170ffb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:15.589616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.590352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.592287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 976/1956] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:15 2022] DELETE /identity/v3/projects/65d1a3052e3a485b983a3e4b170ffb3c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:15.596589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:15.608932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43044-58bb-4c1b-9597-07d1523f49ba service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:15.690545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:15.691490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:15.691950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:15.692361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] PATH_INFO: `/v3/users/e22d9b3d323349c0bdf8572860223744` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:15.693656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22d9b3d323349c0bdf8572860223744)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.696063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:15.751973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22d9b3d323349c0bdf8572860223744'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.752897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22d9b3d323349c0bdf8572860223744'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.763606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22d9b3d323349c0bdf8572860223744'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.764196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22d9b3d323349c0bdf8572860223744'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.771550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22d9b3d323349c0bdf8572860223744'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.790477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 981/1957] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:15 2022] DELETE /identity/v3/users/e22d9b3d323349c0bdf8572860223744 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:16.097673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.100422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.118508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e517271-cc99-40f7-9b2c-c30e2101d892 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.194185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.195528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.195528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.195736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] PATH_INFO: `/v3/projects/4f000088be5a434b85ceb259dd089020` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.197082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f000088be5a434b85ceb259dd089020)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.199258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.269903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f000088be5a434b85ceb259dd089020', 'request_id': 'req-dbb4d6cb-3640-4a06-a478-62f480e2b33f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.278537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f000088be5a434b85ceb259dd089020', 'request_id': 'req-dbb4d6cb-3640-4a06-a478-62f480e2b33f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.285824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f000088be5a434b85ceb259dd089020', 'request_id': 'req-dbb4d6cb-3640-4a06-a478-62f480e2b33f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.303078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] The token cache is being invalidate because project 4f000088be5a434b85ceb259dd089020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:16.303517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.304188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.305727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 977/1958] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:16 2022] DELETE /identity/v3/projects/4f000088be5a434b85ceb259dd089020 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:16.310056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.311579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.342245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f25b9-c722-4a71-8ca5-c2a3f9be0488 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.429517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:16.455385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.456132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.457233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.457494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] PATH_INFO: `/v3/users/350e03b2cd664103b44d978060673089` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.458694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=350e03b2cd664103b44d978060673089)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.461975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.526628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350e03b2cd664103b44d978060673089'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.527393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350e03b2cd664103b44d978060673089'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.537277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350e03b2cd664103b44d978060673089'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.538728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350e03b2cd664103b44d978060673089'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.546572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350e03b2cd664103b44d978060673089'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.557552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.559224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.589641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 982/1959] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:16 2022] DELETE /identity/v3/users/350e03b2cd664103b44d978060673089 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:16.641909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4d6cb-3640-4a06-a478-62f480e2b33f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.674838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:16.735275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.736327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.736327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.736549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.738367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.840148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.841600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fe79c-c1bc-453f-a908-351ff051bef6 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.852749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 978/1960] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:17.055977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.057470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.131525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb5b8-fe28-46d1-bdab-ec03f7da4ebb admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.136569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.137234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.137516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.137807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] PATH_INFO: `/v3/projects/cfff07c4eef94c89a80c018cfad2a585` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.139088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfff07c4eef94c89a80c018cfad2a585)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.141064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.203432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfff07c4eef94c89a80c018cfad2a585', 'request_id': 'req-4425cc9f-f5d8-4927-8115-cd4df4ed500a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:17.214164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfff07c4eef94c89a80c018cfad2a585', 'request_id': 'req-4425cc9f-f5d8-4927-8115-cd4df4ed500a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:17.228175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfff07c4eef94c89a80c018cfad2a585', 'request_id': 'req-4425cc9f-f5d8-4927-8115-cd4df4ed500a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:17.230935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:17.244022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] The token cache is being invalidate because project cfff07c4eef94c89a80c018cfad2a585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:17.244331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:17.244967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4425cc9f-f5d8-4927-8115-cd4df4ed500a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:17.246849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 983/1961] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:17 2022] DELETE /identity/v3/projects/cfff07c4eef94c89a80c018cfad2a585 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:17.254155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.254719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.254719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.276413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:17.277636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.343382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 979/1962] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:17.352490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.352772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.353039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.373471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:17.374578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.383806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 984/1963] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:17.388654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.398695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f97ee-64af-4f13-961c-525ec9429e18 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.403246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.403860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.404133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.404403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.405049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:17.405346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.407435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.429186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 980/1964] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:17.433571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.443478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19567-88c5-44cc-a514-141e4929ee1c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.450258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.450887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.453079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.453079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.453079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.457476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.494580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 985/1965] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:17.498657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.512610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133945a-3b05-48b3-95be-5e7b823e62a1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.568522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:17.578396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.579189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.579471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.579745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.580387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.582322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.610605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 981/1966] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:17 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:17.611846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.622666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f3c0b-5b03-42f9-87f1-5ee25a5e59b0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.627829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.628374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.628652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.628921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.629599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.631228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.641786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 986/1967] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:17.645838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.656375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe012be-ccb1-446e-8a38-69989bd7ecd3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.661087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad69d84-a867-40c9-9d18-f7fa16d848cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.661692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69d84-a867-40c9-9d18-f7fa16d848cb admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.661974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69d84-a867-40c9-9d18-f7fa16d848cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.662247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69d84-a867-40c9-9d18-f7fa16d848cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.662924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad69d84-a867-40c9-9d18-f7fa16d848cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.664778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad69d84-a867-40c9-9d18-f7fa16d848cb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.677744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 982/1968] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:17.682636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.693615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7092e-4876-4bd9-8dd9-7dcd416efe6f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.699448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.700174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.700508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.700790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] PATH_INFO: `/v3/projects/cae5eed37bc54edea544abc96432f4de/users/039e11d2d9a14d809477953a2fd4dc51/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.718011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5eed37bc54edea544abc96432f4de, user_id=039e11d2d9a14d809477953a2fd4dc51, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.721895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.736032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 987/1969] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:17 2022] PUT /identity/v3/projects/cae5eed37bc54edea544abc96432f4de/users/039e11d2d9a14d809477953a2fd4dc51/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:17.741484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190029a-9c78-4e7f-99c6-c211a5169f67 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.741805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190029a-9c78-4e7f-99c6-c211a5169f67 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.742192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190029a-9c78-4e7f-99c6-c211a5169f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.762479 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4190029a-9c78-4e7f-99c6-c211a5169f67 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:17.764428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4190029a-9c78-4e7f-99c6-c211a5169f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.831143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 983/1970] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:17.841099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.842995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.916034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908c3e-99f1-4ae5-8080-34cda5ad48f4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.925511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.926473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.926793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.927163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.960307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.961903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.972997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 988/1971] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:19.158091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.158724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.158803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.190588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] MFA Rules not processed for user `039e11d2d9a14d809477953a2fd4dc51`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:19.191921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:19.281162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 984/1972] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:19.285557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.295881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b740-9d32-4deb-a8b1-22ae49b82cf3 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.300460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.301071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.301355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.301630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.302258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.304535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.343172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 989/1973] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:19.344367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.356339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d612f-24b9-42d2-a470-0d55a6027f98 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.420971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.421592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.422023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.422149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.422767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.424750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.434553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:19.448190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 985/1974] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:19 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:19.452207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.463175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011f5f0-414f-4ec3-a5c9-63ce0c0a92a1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.467982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.468893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.469073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.469376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.469977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.471645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.484848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 990/1975] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:19.488673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.499408 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20412bbe-9b3b-41ba-b912-15d775ab2512 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.504888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.505732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.506038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.506462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] PATH_INFO: `/v3/projects/43404bc39f45443a973c1179b0205a3b/users/348d5962dd814b268e922acc88ed47e6/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.526825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43404bc39f45443a973c1179b0205a3b, user_id=348d5962dd814b268e922acc88ed47e6, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.529624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.546773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 986/1976] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:19 2022] PUT /identity/v3/projects/43404bc39f45443a973c1179b0205a3b/users/348d5962dd814b268e922acc88ed47e6/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:19.558198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.573876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63ad04-5e8b-49a3-8af4-766c59196fc4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.634767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff8c70-da84-44c1-86ef-c5e0679d72f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.636053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff8c70-da84-44c1-86ef-c5e0679d72f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.636334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff8c70-da84-44c1-86ef-c5e0679d72f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.636605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff8c70-da84-44c1-86ef-c5e0679d72f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.637270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff8c70-da84-44c1-86ef-c5e0679d72f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.638947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff8c70-da84-44c1-86ef-c5e0679d72f6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.640385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:19.656972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.659112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 991/1977] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:19.674791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9c0fd-b790-426b-afb6-ed24934ccdf5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.681961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c10e-1067-4a40-818d-ab80871c2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.682636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c10e-1067-4a40-818d-ab80871c2c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.682913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c10e-1067-4a40-818d-ab80871c2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.683223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c10e-1067-4a40-818d-ab80871c2c2c admin admin] PATH_INFO: `/v3/projects/43404bc39f45443a973c1179b0205a3b/users/348d5962dd814b268e922acc88ed47e6/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.685116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c10e-1067-4a40-818d-ab80871c2c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43404bc39f45443a973c1179b0205a3b, user_id=348d5962dd814b268e922acc88ed47e6, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.687855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c10e-1067-4a40-818d-ab80871c2c2c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.699235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 987/1978] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:19 2022] PUT /identity/v3/projects/43404bc39f45443a973c1179b0205a3b/users/348d5962dd814b268e922acc88ed47e6/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:20.375321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.375885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.375885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.408819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] MFA Rules not processed for user `348d5962dd814b268e922acc88ed47e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:20.410054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:20.513981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 992/1979] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:20.528616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.529154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.529154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.550929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] MFA Rules not processed for user `039e11d2d9a14d809477953a2fd4dc51`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:20.552347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:20.623953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 988/1980] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:20.640175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:20.642069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:20.738551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbdd6-32f3-4850-89a4-171c95af7a34 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:20.745530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386744c-3ad4-4197-8685-26eae41cf664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:20.746176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386744c-3ad4-4197-8685-26eae41cf664 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.746458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386744c-3ad4-4197-8685-26eae41cf664 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.746733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386744c-3ad4-4197-8685-26eae41cf664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.758481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386744c-3ad4-4197-8685-26eae41cf664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:20.761172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386744c-3ad4-4197-8685-26eae41cf664 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:20.776923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 993/1981] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:21.068517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.072065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.170812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406af0-3a8a-417b-91a6-d3f01958bd53 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.177590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.178514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.180292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.180444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] PATH_INFO: `/v3/users/a92374c8a8be4511808e2a1822b73478` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.181786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92374c8a8be4511808e2a1822b73478)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.184697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.269515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92374c8a8be4511808e2a1822b73478'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.270429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92374c8a8be4511808e2a1822b73478'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.271759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92374c8a8be4511808e2a1822b73478'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.283116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92374c8a8be4511808e2a1822b73478'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.290334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:21.292692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92374c8a8be4511808e2a1822b73478'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.324690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 989/1982] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:21 2022] DELETE /identity/v3/users/a92374c8a8be4511808e2a1822b73478 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:21.329477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.329838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.330113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.352579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:21.354566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.427441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 994/1983] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:21.439154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.440822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.515593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3fbd-907f-4b0d-9246-f98101b9c586 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.523913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.525280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.525741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.527249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.539790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.541260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.561046 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 990/1984] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:01:22.416911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:22.418582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:22.437476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ec68-8893-455e-ac3f-17f16aee0764 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:22.443787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:22.447873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:22.449248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:22.451886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] PATH_INFO: `/v3/projects/468f175d0443411f92746e91d06e920f` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:22.453653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468f175d0443411f92746e91d06e920f)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:22.456336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:22.458229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:22.521944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468f175d0443411f92746e91d06e920f', 'request_id': 'req-4f0ad963-b9ac-4b6b-95cb-863100488655'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.529489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468f175d0443411f92746e91d06e920f', 'request_id': 'req-4f0ad963-b9ac-4b6b-95cb-863100488655'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.537387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468f175d0443411f92746e91d06e920f', 'request_id': 'req-4f0ad963-b9ac-4b6b-95cb-863100488655'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.555894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] The token cache is being invalidate because project 468f175d0443411f92746e91d06e920f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:22.556193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.556834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.558663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 995/1985] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:22 2022] DELETE /identity/v3/projects/468f175d0443411f92746e91d06e920f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:22.562403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:22.573089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707836b2-90aa-433e-a250-b49eb47ecc4e service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:22.630628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:22.631225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:22.631632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:22.632085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] PATH_INFO: `/v3/users/56fc1a9fc063416484723421a4757e34` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:22.633252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fc1a9fc063416484723421a4757e34)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:22.635241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:22.689836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fc1a9fc063416484723421a4757e34'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.690473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fc1a9fc063416484723421a4757e34'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.691162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fc1a9fc063416484723421a4757e34'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.701214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fc1a9fc063416484723421a4757e34'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.711353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a0a6c61d-a539-4f86-86e3-4e57425aa3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fc1a9fc063416484723421a4757e34'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:22.730402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:22.734913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 991/1986] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:22 2022] DELETE /identity/v3/users/56fc1a9fc063416484723421a4757e34 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:23.042372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.044380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.063080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ad963-b9ac-4b6b-95cb-863100488655 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.124290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.125213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.125487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.125759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] PATH_INFO: `/v3/projects/a7b97cc90a364a02854a25c266535eb0` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.126877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b97cc90a364a02854a25c266535eb0)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.128842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.181713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b97cc90a364a02854a25c266535eb0', 'request_id': 'req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:23.188089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b97cc90a364a02854a25c266535eb0', 'request_id': 'req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:23.195092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b97cc90a364a02854a25c266535eb0', 'request_id': 'req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:23.210103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] The token cache is being invalidate because project a7b97cc90a364a02854a25c266535eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:23.210454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:23.211261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ee141a3e-ed3e-4ab0-931b-a0eaec136d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:23.213204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 996/1987] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:23 2022] DELETE /identity/v3/projects/a7b97cc90a364a02854a25c266535eb0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:23.219222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.219510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.219778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.240213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:23.241499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.312718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 992/1988] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:23.321763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51890bc-3a49-4265-98de-66684979816a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.322052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51890bc-3a49-4265-98de-66684979816a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.322326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51890bc-3a49-4265-98de-66684979816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.343193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b51890bc-3a49-4265-98de-66684979816a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:23.344420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b51890bc-3a49-4265-98de-66684979816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.352670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 997/1989] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:23.357043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.367499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f7d0d-0bb8-4bf8-971a-ab0c49ea0622 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.372281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.372915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.373313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.373454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.374234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:23.374542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.376345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.401658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 993/1990] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:23.406032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51890bc-3a49-4265-98de-66684979816a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.415387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51890bc-3a49-4265-98de-66684979816a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.420304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.420925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.421207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.421481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.422127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.424252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.436962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:23.457500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 998/1991] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:23 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:23.461755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.472198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b39dc-519f-4ed6-a9bb-74202f0fd87d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.536690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.537315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.537597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.538061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.539551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.541111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.566716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 994/1992] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:23 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:23.570902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.584726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc575-4505-48fb-8fe4-ecf8b9f6d862 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.590869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.591717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.592126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.592509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.593260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.596108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.610692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 999/1993] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:23.612252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.623470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce3d5c-5319-40a5-b299-cd139292016d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.628264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90015170-c8ef-4058-95f8-56761cbaafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.628882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015170-c8ef-4058-95f8-56761cbaafdc admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.629156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015170-c8ef-4058-95f8-56761cbaafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.629954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90015170-c8ef-4058-95f8-56761cbaafdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.631895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90015170-c8ef-4058-95f8-56761cbaafdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.637043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90015170-c8ef-4058-95f8-56761cbaafdc admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.652212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 995/1994] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:23.656385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.668156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c435-ea3e-4de0-b1c5-667fc013fb0e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.673256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.673942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.674225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.674501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] PATH_INFO: `/v3/projects/23174a16de4a4d2d8df72c146f0013f4/users/447c371eb7f3425982a6dccbb74e9cd8/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.696144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23174a16de4a4d2d8df72c146f0013f4, user_id=447c371eb7f3425982a6dccbb74e9cd8, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.698322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.715855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1000/1995] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:23 2022] PUT /identity/v3/projects/23174a16de4a4d2d8df72c146f0013f4/users/447c371eb7f3425982a6dccbb74e9cd8/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:23.726564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.726958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.727335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.767074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] MFA Rules not processed for user `447c371eb7f3425982a6dccbb74e9cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:23.768312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.841127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:23.854211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 996/1996] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:23.865177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.867192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.931959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a660f-2c21-4646-97f7-61d90d47fcd7 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.936286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.936970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.937312 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.937647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.950495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.952127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.963643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1001/1997] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:33.850542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:33.958565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:36.108079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:36.110215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:36.197386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fa3f3-a6c1-4669-b7cd-8b425a69c883 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:36.203362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:36.204377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.204774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.205068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] PATH_INFO: `/v3/users/b63914ce814a43078a1c177cff9a89fb` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.206318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63914ce814a43078a1c177cff9a89fb)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:36.208353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:36.258889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63914ce814a43078a1c177cff9a89fb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.259751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63914ce814a43078a1c177cff9a89fb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.260428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63914ce814a43078a1c177cff9a89fb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.268402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63914ce814a43078a1c177cff9a89fb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.276672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-81decba0-0134-45fe-8876-7fc9664435fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63914ce814a43078a1c177cff9a89fb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.296556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 997/1998] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:36 2022] DELETE /identity/v3/users/b63914ce814a43078a1c177cff9a89fb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:36.504358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:36.521691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823d72-1754-4f81-93f1-ef949bf94534 service glance] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:36.586558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:36.587419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.587699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.587965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] PATH_INFO: `/v3/projects/4132cc2b40bf416880f4f52c1baa0783` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.589296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4132cc2b40bf416880f4f52c1baa0783)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:36.591304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:36.640943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4132cc2b40bf416880f4f52c1baa0783', 'request_id': 'req-5cd2157c-cec0-4558-9170-06db517a22a6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.646360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4132cc2b40bf416880f4f52c1baa0783', 'request_id': 'req-5cd2157c-cec0-4558-9170-06db517a22a6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.652651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4132cc2b40bf416880f4f52c1baa0783', 'request_id': 'req-5cd2157c-cec0-4558-9170-06db517a22a6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.668536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] The token cache is being invalidate because project 4132cc2b40bf416880f4f52c1baa0783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:36.668833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.669469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5cd2157c-cec0-4558-9170-06db517a22a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:36.670997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1002/1999] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:36 2022] DELETE /identity/v3/projects/4132cc2b40bf416880f4f52c1baa0783 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:36.676102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008a54-cac9-4994-bebe-0244c789856d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.676390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008a54-cac9-4994-bebe-0244c789856d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.676664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008a54-cac9-4994-bebe-0244c789856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.698020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-34008a54-cac9-4994-bebe-0244c789856d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:36.699343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-34008a54-cac9-4994-bebe-0244c789856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:36.766996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 998/2000] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:36.775883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.776198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.776473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.796920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:36.798121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:36.810200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1003/2001] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:36.811648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008a54-cac9-4994-bebe-0244c789856d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:36.824750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008a54-cac9-4994-bebe-0244c789856d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:36.829945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:36.830671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.830949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.831537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.832204 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:36.832656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:36.834253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:36.851647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 999/2002] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:36.853026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:36.862371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d66558-3119-413a-9ffa-c3a619592bdd None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:36.867097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:36.867712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.867993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.868269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.868926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:36.870860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:36.905723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1004/2003] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:36 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:36.909803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:36.920590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e946b-db45-4f50-8206-60eb30fe4de5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:36.924151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:36.985980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:36.986609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:36.987008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:36.987320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:36.987970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:36.989910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:37.022347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1000/2004] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:36 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:37.022479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:37.032488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dfd76-be35-464b-bc66-8d8e9eb0f74f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:37.037349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:37.037961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:37.038194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:37.038466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:37.039182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:37.040872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:37.051331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1005/2005] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:01:37.055793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:37.066723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54397df4-1ca7-423a-b36a-815807094f8b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:37.072855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b278-641a-4f42-ad82-55a3f3fceb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:37.073465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b278-641a-4f42-ad82-55a3f3fceb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:37.073748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b278-641a-4f42-ad82-55a3f3fceb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:37.074023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b278-641a-4f42-ad82-55a3f3fceb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:37.074674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b278-641a-4f42-ad82-55a3f3fceb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:37.076331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b278-641a-4f42-ad82-55a3f3fceb59 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:37.087913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1001/2006] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:37.092332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:37.102660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b935ab-b804-425c-b4c3-28fb9a77cfb1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:37.108325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:37.109050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:37.109323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:37.109587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] PATH_INFO: `/v3/projects/824ec0e55b2541e4ab38810513809d84/users/0d6445eb7a1040e9b398ac134f66be5e/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:37.128356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=824ec0e55b2541e4ab38810513809d84, user_id=0d6445eb7a1040e9b398ac134f66be5e, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:37.131324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:37.154114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1006/2007] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:37 2022] PUT /identity/v3/projects/824ec0e55b2541e4ab38810513809d84/users/0d6445eb7a1040e9b398ac134f66be5e/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:37.164760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:37.165416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:37.165416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:37.194876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] MFA Rules not processed for user `0d6445eb7a1040e9b398ac134f66be5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:37.196190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:37.265775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1002/2008] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:37.276710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:37.278366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:37.311591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:37.360549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566113-6596-4ee2-8b61-e8b3e94b54fa admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:37.366619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee36d6-c77e-410d-87c1-05204868c178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:37.367261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee36d6-c77e-410d-87c1-05204868c178 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:37.367542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee36d6-c77e-410d-87c1-05204868c178 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:37.367818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee36d6-c77e-410d-87c1-05204868c178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:37.380879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee36d6-c77e-410d-87c1-05204868c178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:37.383870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee36d6-c77e-410d-87c1-05204868c178 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:37.397557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1007/2009] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:42.690958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.763505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0c0d6-2ccb-4075-92cb-f65f1a206e91 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:42.770117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:42.770873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.771283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.771606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] PATH_INFO: `/v3/users/0d6445eb7a1040e9b398ac134f66be5e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.772862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6445eb7a1040e9b398ac134f66be5e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:42.774883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:42.792428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:42.837586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6445eb7a1040e9b398ac134f66be5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.838289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6445eb7a1040e9b398ac134f66be5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.839518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6445eb7a1040e9b398ac134f66be5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.849987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6445eb7a1040e9b398ac134f66be5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.859862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6445eb7a1040e9b398ac134f66be5e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.879445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1003/2010] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:42 2022] DELETE /identity/v3/users/0d6445eb7a1040e9b398ac134f66be5e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:42.884223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.884824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.884824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.905094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:42.906412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:42.973421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1008/2011] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:42.984387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.986093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:43.049967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cf9a0-1798-4ba0-bda3-9be37aa720b3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.054870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544e7d6-7072-4d10-85a1-40feaae46f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.055530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e7d6-7072-4d10-85a1-40feaae46f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.056318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e7d6-7072-4d10-85a1-40feaae46f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.056606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544e7d6-7072-4d10-85a1-40feaae46f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.066824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544e7d6-7072-4d10-85a1-40feaae46f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.068295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544e7d6-7072-4d10-85a1-40feaae46f83 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.078753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1004/2012] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:43.387028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.388735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:43.401524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc5535-2c7a-4422-963d-1007773dc970 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.406949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.407631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.407912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.408185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] PATH_INFO: `/v3/projects/824ec0e55b2541e4ab38810513809d84` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.409833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=824ec0e55b2541e4ab38810513809d84)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.411821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.465250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824ec0e55b2541e4ab38810513809d84', 'request_id': 'req-33e52d0b-a075-45da-9269-7a831bf17d0f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:43.481209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824ec0e55b2541e4ab38810513809d84', 'request_id': 'req-33e52d0b-a075-45da-9269-7a831bf17d0f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:43.493383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824ec0e55b2541e4ab38810513809d84', 'request_id': 'req-33e52d0b-a075-45da-9269-7a831bf17d0f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:43.514534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] The token cache is being invalidate because project 824ec0e55b2541e4ab38810513809d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:43.514833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:43.515570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-33e52d0b-a075-45da-9269-7a831bf17d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:43.517137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1009/2013] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:43 2022] DELETE /identity/v3/projects/824ec0e55b2541e4ab38810513809d84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:43.522110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.522421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.522743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.544749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:43.545963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:43.610399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1005/2014] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:43.617880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.618228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.618510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.641727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:43.642958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:43.652679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1010/2015] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:43.657041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.667505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d630-9fcc-43e6-b719-419abf30443a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.672486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.673095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.673378 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.673658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.674300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:43.674609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.676258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.688276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1006/2016] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:43.692712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.702648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909adecc-fe89-4a3b-a9ba-0701173d0b45 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.708429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.709034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.709313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.709582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.710208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.712318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.742743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1011/2017] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:43.747291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.757467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8515-320b-4424-844f-64d81a7de7b0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.778439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:43.818741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.819569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.819697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.819981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.820603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.822625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.846401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1007/2018] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:43 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:43.850919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.862187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dee631-b7ae-42c3-aca1-8c3f214e61fb admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.867906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.868588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.869016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.869289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.869940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.871651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.876012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:43.887926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1012/2019] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:43.891949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.902512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409c22-bdd6-4048-8869-ad316966c2f6 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.907568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107efc85-804f-46b2-bb28-d2c1f6f42fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.908180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107efc85-804f-46b2-bb28-d2c1f6f42fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.908461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107efc85-804f-46b2-bb28-d2c1f6f42fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.908761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107efc85-804f-46b2-bb28-d2c1f6f42fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.909531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107efc85-804f-46b2-bb28-d2c1f6f42fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.911160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107efc85-804f-46b2-bb28-d2c1f6f42fbb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.922586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1008/2020] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:43.926624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.938129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b2ecc-d97a-43e5-9e9d-ecbfa0ab3a2f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.943590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.944274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.944554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.944831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] PATH_INFO: `/v3/projects/6bdb8f6e09dd4de6a320334f7ca50585/users/82949f76f0f144ac9c095c696230b98e/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.965279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdb8f6e09dd4de6a320334f7ca50585, user_id=82949f76f0f144ac9c095c696230b98e, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.968030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.988772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1013/2021] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:43 2022] PUT /identity/v3/projects/6bdb8f6e09dd4de6a320334f7ca50585/users/82949f76f0f144ac9c095c696230b98e/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:44.011206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.011879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.014431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.043825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] MFA Rules not processed for user `82949f76f0f144ac9c095c696230b98e`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:44.045121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:44.116995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1009/2022] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:44.121505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.188266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c59d-5fe4-431d-b9ae-913aceb991b5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.193763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.194374 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.194649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.194913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.195594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.198203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.242591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1014/2023] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:44 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:44.246799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.259519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb67bf7-8485-45e1-9776-614e2af298cc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.319091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.320051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.320311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.320590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.321256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.323387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.348051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1010/2024] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:44 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:44.352213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.363760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb6d8-72d5-4f87-ba3b-65c2f3cffabf admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.370093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.370644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.370926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.371240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.371890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.373516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.385141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1015/2025] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:44.390684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.401264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0a571-e840-4868-8726-e285638e9654 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.407527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.408197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.408484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.408742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] PATH_INFO: `/v3/projects/f54dccad7bad4817b0cf8b192b60d7d7/users/b66fbdd7e8db4daca0187a3629037b08/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.426833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54dccad7bad4817b0cf8b192b60d7d7, user_id=b66fbdd7e8db4daca0187a3629037b08, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.429577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.440928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:44.449356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1011/2026] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:44 2022] PUT /identity/v3/projects/f54dccad7bad4817b0cf8b192b60d7d7/users/b66fbdd7e8db4daca0187a3629037b08/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:44.452795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.463908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cf3e8-045f-4f14-a421-a64243d0b0c3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.533135 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d575c-8465-440f-a445-ccf8503c6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.533755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d575c-8465-440f-a445-ccf8503c6b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.534033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d575c-8465-440f-a445-ccf8503c6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.534302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d575c-8465-440f-a445-ccf8503c6b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.534958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d575c-8465-440f-a445-ccf8503c6b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.536629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d575c-8465-440f-a445-ccf8503c6b3d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.546935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1016/2027] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:44.551297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.562159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2f2d2-dcb7-4ea2-9828-557c6b2f6e91 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.567029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.567715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.567997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.568270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] PATH_INFO: `/v3/projects/f54dccad7bad4817b0cf8b192b60d7d7/users/b66fbdd7e8db4daca0187a3629037b08/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.570392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54dccad7bad4817b0cf8b192b60d7d7, user_id=b66fbdd7e8db4daca0187a3629037b08, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.573556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.585064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1012/2028] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:44 2022] PUT /identity/v3/projects/f54dccad7bad4817b0cf8b192b60d7d7/users/b66fbdd7e8db4daca0187a3629037b08/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:44.595702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.595977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.596271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.629270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] MFA Rules not processed for user `b66fbdd7e8db4daca0187a3629037b08`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:44.630393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:44.669669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:44.715228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1017/2029] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:44.727038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.729359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:44.794696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e6d4c-f676-4c9e-816c-a80372a8989a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.800487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.801345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.801653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.801953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.814452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.816546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.831861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1013/2030] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:44.927676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.937928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add352e-50c1-4829-acea-4fb00e02be78 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.941641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.942245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.942523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.942794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:45.005180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:45.006619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:45.015912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1018/2031] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:53.364547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:53.373907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8266e5-bde4-4ae9-842d-d41b1a531320 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:53.378582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:53.379245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:53.379527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:53.379784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:53.381739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:53.451915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:53.453371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec6bfa-9458-461b-a951-df01bb26f52a service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:53.464168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1014/2032] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:55.011789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=43 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:57.363270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:57.365022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:57.438085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95b23-7c14-4ff0-934c-631ab02b46c0 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:57.443061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:57.443795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:57.444142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:57.444482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] PATH_INFO: `/v3/users/f21f96019e8e4143ab21d0aadacd7014` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:57.446131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21f96019e8e4143ab21d0aadacd7014)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:57.449165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:57.510906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21f96019e8e4143ab21d0aadacd7014'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:57.511731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21f96019e8e4143ab21d0aadacd7014'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:57.521524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21f96019e8e4143ab21d0aadacd7014'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:57.522254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21f96019e8e4143ab21d0aadacd7014'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:57.531901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21f96019e8e4143ab21d0aadacd7014'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:57.554061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1019/2033] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:57 2022] DELETE /identity/v3/users/f21f96019e8e4143ab21d0aadacd7014 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:57.559484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:57.560000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:57.560089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:57.579897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:57.582336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:57.646785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1015/2034] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:57.657052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:57.658631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:57.721973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba977-5774-49cf-be1c-6f78974354a2 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:57.726565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:57.728801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:57.728801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:57.728801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:57.742525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:57.745372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:57.756663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1020/2035] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:58.045173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:58.047582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:58.099173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d7699-06d1-446a-a0e9-84a0a8cadaac None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:58.112426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:58.113425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:58.113735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:58.114154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] PATH_INFO: `/v3/projects/1226d31c51b840e997eefd767e1e3c39` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:58.117022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1226d31c51b840e997eefd767e1e3c39)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:58.123632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:58.169172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:58.218102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1226d31c51b840e997eefd767e1e3c39', 'request_id': 'req-6afa13f5-d65e-46ff-8ead-4e491240aa4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:58.224778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1226d31c51b840e997eefd767e1e3c39', 'request_id': 'req-6afa13f5-d65e-46ff-8ead-4e491240aa4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:58.230468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1226d31c51b840e997eefd767e1e3c39', 'request_id': 'req-6afa13f5-d65e-46ff-8ead-4e491240aa4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:58.244091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] The token cache is being invalidate because project 1226d31c51b840e997eefd767e1e3c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:58.244376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:58.245098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6afa13f5-d65e-46ff-8ead-4e491240aa4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:58.246618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1016/2036] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:58 2022] DELETE /identity/v3/projects/1226d31c51b840e997eefd767e1e3c39 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:07.752004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:08.240787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:11.580758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:11.583524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:11.599812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45089ad0-71f5-43bd-b30d-74a225f865c9 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:11.687685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:11.688405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:11.688916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:11.689024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] PATH_INFO: `/v3/users/447c371eb7f3425982a6dccbb74e9cd8` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:11.690110 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=447c371eb7f3425982a6dccbb74e9cd8)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:11.692244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:11.771511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447c371eb7f3425982a6dccbb74e9cd8'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:11.772440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447c371eb7f3425982a6dccbb74e9cd8'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:11.781080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447c371eb7f3425982a6dccbb74e9cd8'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:11.781728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447c371eb7f3425982a6dccbb74e9cd8'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:11.789777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447c371eb7f3425982a6dccbb74e9cd8'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:11.814164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1021/2037] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:11 2022] DELETE /identity/v3/users/447c371eb7f3425982a6dccbb74e9cd8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:11.819308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:11.819748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:11.819862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:11.841120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:11.842510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:11.929158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1017/2038] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:11.936118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:11.937558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:12.007957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ecc44-1389-43a3-9fb8-4a1891f8c9f2 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.012398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062ad7c-6396-47a8-944c-db652ae7c0c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.013020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ad7c-6396-47a8-944c-db652ae7c0c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.013298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ad7c-6396-47a8-944c-db652ae7c0c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.013571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ad7c-6396-47a8-944c-db652ae7c0c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.024230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062ad7c-6396-47a8-944c-db652ae7c0c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.026015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062ad7c-6396-47a8-944c-db652ae7c0c8 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.036648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1022/2039] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:12.408784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.410777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:12.424145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0e651-458b-4cf4-a17d-21121006c532 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.429380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.430047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.430448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.430722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] PATH_INFO: `/v3/projects/23174a16de4a4d2d8df72c146f0013f4` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.432075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23174a16de4a4d2d8df72c146f0013f4)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.434010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.490872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23174a16de4a4d2d8df72c146f0013f4', 'request_id': 'req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:12.498465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23174a16de4a4d2d8df72c146f0013f4', 'request_id': 'req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:12.504065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23174a16de4a4d2d8df72c146f0013f4', 'request_id': 'req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:12.518210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] The token cache is being invalidate because project 23174a16de4a4d2d8df72c146f0013f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:12.518498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:12.519290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-9dbf8f96-9ae3-4c08-97b2-b36cfa39da2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:12.520880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1018/2040] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:12 2022] DELETE /identity/v3/projects/23174a16de4a4d2d8df72c146f0013f4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:12.525971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.526292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.526572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.549579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:12.550909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:12.569430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:12.626751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1023/2041] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:12.639665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.640047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.640439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.661701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:12.662949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:12.672775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1019/2042] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:12.679347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.689853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d2ca-541b-4b71-8594-ad30d671f50f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.695391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.696329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.696653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.696997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.697920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:12.698305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.700415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.714552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1024/2043] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:12.720200 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.730371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ff204-4178-4d40-a0b5-a8c8325861bc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.736013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.736664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.736942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.737239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.737845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.739831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.771932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1020/2044] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:12 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:12.780201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.796188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01a207-c92e-4d80-810f-070328f24b31 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.857597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.858219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.858494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.858767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.859431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.861439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.885259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1025/2045] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:12 2022] POST /identity/v3/users => generated 281 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:12.890067 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.902167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ffa7-13b7-4a7d-9cbd-b37af612a6d4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.909241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.909241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.909241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.909241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.909587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.910963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.927585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1021/2046] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:12.929009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.951849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5509a-f449-485e-946d-0991d81d3936 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:12.957430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76d098-5b0b-48c2-979b-995e39cf2adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:12.958091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76d098-5b0b-48c2-979b-995e39cf2adf admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:12.958351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76d098-5b0b-48c2-979b-995e39cf2adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:12.958619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76d098-5b0b-48c2-979b-995e39cf2adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:12.959311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76d098-5b0b-48c2-979b-995e39cf2adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:12.960945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76d098-5b0b-48c2-979b-995e39cf2adf admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:12.976841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1026/2047] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:02:12.981974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:12.996036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc2fae-fb7b-4d65-8133-bf363867b62c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:13.003147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:13.003908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:13.004258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:13.004600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] PATH_INFO: `/v3/projects/a46a23390d864d1b8436bb53fb47e64f/users/c057d06320dc4b6baef787a117fbfd7c/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:13.021317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46a23390d864d1b8436bb53fb47e64f, user_id=c057d06320dc4b6baef787a117fbfd7c, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:13.024268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:13.046538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1022/2048] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:12 2022] PUT /identity/v3/projects/a46a23390d864d1b8436bb53fb47e64f/users/c057d06320dc4b6baef787a117fbfd7c/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:13.063692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:13.064152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:13.064615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:13.108527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] MFA Rules not processed for user `c057d06320dc4b6baef787a117fbfd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:13.110394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:13.191670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1027/2049] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:13.231118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:13.233333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:13.258052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:13.298140 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccf84d-92a4-4427-b82f-fad4b6226ddd admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:13.301955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:13.302654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:13.302962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:13.303259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:13.313763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:13.315447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:13.326874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1023/2050] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:15.918991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:15.923205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:15.957331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:16.009316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc7616-880f-470f-9bda-f917f49e034e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:16.013932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:16.014563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:16.014839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:16.015133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] PATH_INFO: `/v3/users/039e11d2d9a14d809477953a2fd4dc51` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:16.016289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=039e11d2d9a14d809477953a2fd4dc51)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:16.018251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:16.066829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039e11d2d9a14d809477953a2fd4dc51'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.067527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039e11d2d9a14d809477953a2fd4dc51'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.075144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039e11d2d9a14d809477953a2fd4dc51'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.075776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039e11d2d9a14d809477953a2fd4dc51'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.083439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039e11d2d9a14d809477953a2fd4dc51'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.102230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1028/2051] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:15 2022] DELETE /identity/v3/users/039e11d2d9a14d809477953a2fd4dc51 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:16.294669 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:16.305464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd1314-8b54-4bcc-b4d7-334e123976ff service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:16.380534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:16.381276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:16.381722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:16.381986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] PATH_INFO: `/v3/projects/cae5eed37bc54edea544abc96432f4de` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:16.383316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae5eed37bc54edea544abc96432f4de)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:16.385136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:16.438157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae5eed37bc54edea544abc96432f4de', 'request_id': 'req-146bc8dc-b615-4169-b515-8fc29ec88403'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.444623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae5eed37bc54edea544abc96432f4de', 'request_id': 'req-146bc8dc-b615-4169-b515-8fc29ec88403'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.453059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae5eed37bc54edea544abc96432f4de', 'request_id': 'req-146bc8dc-b615-4169-b515-8fc29ec88403'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.470400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] The token cache is being invalidate because project cae5eed37bc54edea544abc96432f4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:16.470699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.471380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.473206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1024/2052] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:16 2022] DELETE /identity/v3/projects/cae5eed37bc54edea544abc96432f4de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:16.477351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:16.478974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:16.495206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044ce8-f8cb-45d0-9633-8933c469f1bb admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:16.570112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:16.570759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:16.571042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:16.571346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] PATH_INFO: `/v3/users/348d5962dd814b268e922acc88ed47e6` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:16.572912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=348d5962dd814b268e922acc88ed47e6)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:16.575681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:16.623094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:16.632823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348d5962dd814b268e922acc88ed47e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.633668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348d5962dd814b268e922acc88ed47e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.642892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348d5962dd814b268e922acc88ed47e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.643617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348d5962dd814b268e922acc88ed47e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.656163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1c34d701-acdc-426b-94d4-d8479a00d1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348d5962dd814b268e922acc88ed47e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:16.688958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1029/2053] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:16 2022] DELETE /identity/v3/users/348d5962dd814b268e922acc88ed47e6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:16.873206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:16.874668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:16.895322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc8dc-b615-4169-b515-8fc29ec88403 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:16.947397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:16.959956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:16.960694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:16.961102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:16.961396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] PATH_INFO: `/v3/projects/43404bc39f45443a973c1179b0205a3b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:16.962704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43404bc39f45443a973c1179b0205a3b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:16.965388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.016074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43404bc39f45443a973c1179b0205a3b', 'request_id': 'req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:17.022366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43404bc39f45443a973c1179b0205a3b', 'request_id': 'req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:17.029544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43404bc39f45443a973c1179b0205a3b', 'request_id': 'req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:17.044377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] The token cache is being invalidate because project 43404bc39f45443a973c1179b0205a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:17.044936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:17.046001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a63281ff-62bf-4eec-bf7c-7c0d7d97ac39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:17.047810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1025/2054] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:16 2022] DELETE /identity/v3/projects/43404bc39f45443a973c1179b0205a3b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:17.062708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.063318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.063431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.085823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:17.087918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:17.159368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1030/2055] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:17.167582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.167908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.168179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.191076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:17.192297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:17.203305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1026/2056] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:17.208355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.220059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fa9fa-3e17-4aad-a996-ee2ababf2df8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.225957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.226582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.226872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.227176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.228028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:17.228413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.229958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.242340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1031/2057] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:17.247434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.258103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345a65-1e0b-459f-b8b6-78e7acf0dd4b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.280568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.281205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.281750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.282016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.282748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.284819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.317877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1027/2058] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:17 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:17.319889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.330627 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262044-75f4-4aaf-bd70-5891716adf6f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.397158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.397938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.398124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.398391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.399096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.401410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.423985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1032/2059] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:17 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:17.428493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.439882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c552a-b930-49d7-8994-81497afadc07 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.444658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.445262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.445691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.445989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.446637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.448462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.460826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1028/2060] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:17.465310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.475644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a98a-3197-4dd4-b9f5-6a5ba313d1c5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.481300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61f0c8-2f8b-4f25-a84c-94352f122ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.482107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61f0c8-2f8b-4f25-a84c-94352f122ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.482496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61f0c8-2f8b-4f25-a84c-94352f122ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.482913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61f0c8-2f8b-4f25-a84c-94352f122ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.483863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61f0c8-2f8b-4f25-a84c-94352f122ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.486830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61f0c8-2f8b-4f25-a84c-94352f122ac8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.503358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1033/2061] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:17.508167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.519187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b416df0-bd58-416b-b025-002cf3fd4bea admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.524950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.525663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.525940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.526217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] PATH_INFO: `/v3/projects/7bd3f92e47e24d7684f7084b8283f3d8/users/c64f97f557974463bea0d985cc9de324/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.548982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd3f92e47e24d7684f7084b8283f3d8, user_id=c64f97f557974463bea0d985cc9de324, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.551705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.566366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1029/2062] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:17 2022] PUT /identity/v3/projects/7bd3f92e47e24d7684f7084b8283f3d8/users/c64f97f557974463bea0d985cc9de324/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:17.576634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.576923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.577205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.615244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] MFA Rules not processed for user `c64f97f557974463bea0d985cc9de324`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:17.616501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:17.628274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:17.691698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1034/2063] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:17.702713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:17.704589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:17.771757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268104-e1d6-4dfe-b1e5-ddf37942868f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:17.776541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42fb27-9a24-43ed-b6a3-0bdf9019fac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:17.777166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42fb27-9a24-43ed-b6a3-0bdf9019fac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:17.777442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42fb27-9a24-43ed-b6a3-0bdf9019fac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:17.777715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42fb27-9a24-43ed-b6a3-0bdf9019fac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:17.786756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42fb27-9a24-43ed-b6a3-0bdf9019fac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:17.788229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42fb27-9a24-43ed-b6a3-0bdf9019fac1 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:17.799716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1030/2064] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:18.266311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:18.268347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:18.344057 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45666-8479-4fd2-8f0a-a38c143e3653 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:18.349851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:18.350490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:18.350766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:18.351036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] PATH_INFO: `/v3/users/82949f76f0f144ac9c095c696230b98e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:18.352285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82949f76f0f144ac9c095c696230b98e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:18.354386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:18.409459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82949f76f0f144ac9c095c696230b98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:18.410217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82949f76f0f144ac9c095c696230b98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:18.419475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82949f76f0f144ac9c095c696230b98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:18.420266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82949f76f0f144ac9c095c696230b98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:18.429034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82949f76f0f144ac9c095c696230b98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:18.448774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1035/2065] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:18 2022] DELETE /identity/v3/users/82949f76f0f144ac9c095c696230b98e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:18.453674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:18.454150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:18.454150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:18.475744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:18.476953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:18.497278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:18.551282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1031/2066] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:18.561529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:18.563168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:18.603878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:18.632583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e4f2c-399a-45cf-8091-15fe22a00e40 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:18.636630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:18.637300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:18.637612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:18.637850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:18.648860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:18.650724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:18.663500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1036/2067] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:19.014983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:19.016471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:19.030912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef042e6-3a4d-4c73-ad01-b5d9ae58f336 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:19.045344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:19.046381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:19.047087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:19.047598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] PATH_INFO: `/v3/projects/6bdb8f6e09dd4de6a320334f7ca50585` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:19.049339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdb8f6e09dd4de6a320334f7ca50585)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:19.052619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:19.112631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdb8f6e09dd4de6a320334f7ca50585', 'request_id': 'req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.120360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdb8f6e09dd4de6a320334f7ca50585', 'request_id': 'req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.127648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdb8f6e09dd4de6a320334f7ca50585', 'request_id': 'req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.141864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] The token cache is being invalidate because project 6bdb8f6e09dd4de6a320334f7ca50585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:19.142152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.142786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.144345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1032/2068] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:19 2022] DELETE /identity/v3/projects/6bdb8f6e09dd4de6a320334f7ca50585 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:19.148407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:19.167432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d45d1-18a2-4604-96a2-a7c7f1a40e88 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:19.251930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:19.252656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:19.253003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:19.253344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] PATH_INFO: `/v3/users/b66fbdd7e8db4daca0187a3629037b08` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:19.254601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66fbdd7e8db4daca0187a3629037b08)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:19.256899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:19.365409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66fbdd7e8db4daca0187a3629037b08'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.366542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66fbdd7e8db4daca0187a3629037b08'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.378510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66fbdd7e8db4daca0187a3629037b08'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.379602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66fbdd7e8db4daca0187a3629037b08'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.388095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-aa9eaaaf-a36f-4abb-b63c-1dc43bb8d205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66fbdd7e8db4daca0187a3629037b08'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.411007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1037/2069] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:19 2022] DELETE /identity/v3/users/b66fbdd7e8db4daca0187a3629037b08 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:19.719376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:19.725807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:19.750638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9fff6-b2f0-415d-b24c-9a0594cc4dc3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:19.859375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:19.860109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:19.860464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:19.860816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] PATH_INFO: `/v3/projects/f54dccad7bad4817b0cf8b192b60d7d7` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:19.862248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54dccad7bad4817b0cf8b192b60d7d7)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:19.864320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:19.935419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:19.935419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54dccad7bad4817b0cf8b192b60d7d7', 'request_id': 'req-69d10765-f7ef-47f5-8f6a-e10d3730523e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.938549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54dccad7bad4817b0cf8b192b60d7d7', 'request_id': 'req-69d10765-f7ef-47f5-8f6a-e10d3730523e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.949915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54dccad7bad4817b0cf8b192b60d7d7', 'request_id': 'req-69d10765-f7ef-47f5-8f6a-e10d3730523e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.970471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] The token cache is being invalidate because project f54dccad7bad4817b0cf8b192b60d7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:19.970960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.972054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-69d10765-f7ef-47f5-8f6a-e10d3730523e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:19.974596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1033/2070] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:19 2022] DELETE /identity/v3/projects/f54dccad7bad4817b0cf8b192b60d7d7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:19.979203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:19.979473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:19.979751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.000186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:20.001223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:20.052148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:20.068863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1038/2071] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:20.078343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.078700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.079012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.101774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:20.103026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:20.112605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1034/2072] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:20.117359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.127994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a9103-a076-4415-84b1-4943fc8ae3e3 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.133735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.134417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.135000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.135282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.135960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:20.136294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.137922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.153666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1039/2073] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:20.158377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.177714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462a9ae-83f5-48e6-81de-ada420a6a50c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.183288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.183908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.184188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.184458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.185085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.187022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.221543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1035/2074] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:20 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:20.225999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.237275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e8c3f-9d52-4064-b511-49acf090d558 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.311625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.312256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.312541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.312817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.313464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.315467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.339764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1040/2075] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:20 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:20.344138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.355896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82375cd1-0037-4711-831c-2753e25f63db admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.361290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.361904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.362315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.362885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.363116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.365537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.377546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1036/2076] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:20.381648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.392241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915da9-2bea-49cf-bc42-1b7e8059d7ce admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.397155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d431fc-49f0-4912-a9f1-264213161fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.397762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d431fc-49f0-4912-a9f1-264213161fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.398041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d431fc-49f0-4912-a9f1-264213161fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.398321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d431fc-49f0-4912-a9f1-264213161fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.398996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d431fc-49f0-4912-a9f1-264213161fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.400667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d431fc-49f0-4912-a9f1-264213161fd5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.413205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1041/2077] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:20.418184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.432633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6c2a-3595-412b-9754-1f1b8dab5420 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.437517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.438187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.438632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.438788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] PATH_INFO: `/v3/projects/f9cdfb0231bc4f1fa458e50fa02f6e17/users/5cafbe35a93245e3963c656e2a519b92/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.458710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cdfb0231bc4f1fa458e50fa02f6e17, user_id=5cafbe35a93245e3963c656e2a519b92, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.461992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.477357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1037/2078] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:20 2022] PUT /identity/v3/projects/f9cdfb0231bc4f1fa458e50fa02f6e17/users/5cafbe35a93245e3963c656e2a519b92/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:20.488604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.489001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.489343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.522867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] MFA Rules not processed for user `5cafbe35a93245e3963c656e2a519b92`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:20.524115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:20.603737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1042/2079] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:20.605123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.698377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770435b-b27c-40aa-93a4-0ecb0403e53d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.708849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.709566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.710511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.710744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.715842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.719813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.753317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1038/2080] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:20 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:20.757756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.769453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7080430-a2e8-45b8-83e0-da7abfd80540 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.825102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:20.841633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.842194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.842471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.842746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.843498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.845461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.873751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1043/2081] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:20 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:20.878159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.888784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9ee8-8be0-4816-b0d3-1a09eab605ea admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.894738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.895357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.895631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.895895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.896536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.898137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.911769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1039/2082] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:20.916175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.927037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2528-ef01-4295-beb9-b410e974b161 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:20.933148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:20.933955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:20.934243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:20.934526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] PATH_INFO: `/v3/projects/001f602906d345ddbe38bcc8fa02ad72/users/9d586c79ae4e4a7fa6b8944a0a5152d3/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:20.951654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] RBAC: Authorizing `identity:create_grant(project_id=001f602906d345ddbe38bcc8fa02ad72, user_id=9d586c79ae4e4a7fa6b8944a0a5152d3, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:20.954369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:20.970957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1044/2083] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:20 2022] PUT /identity/v3/projects/001f602906d345ddbe38bcc8fa02ad72/users/9d586c79ae4e4a7fa6b8944a0a5152d3/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:20.975212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:20.986317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffb6f7-4693-4b90-8f54-e2505fb21bd4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.050854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:21.055656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.057180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.076751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.077304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.077588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.077861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.078520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.080183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.094107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1040/2084] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:21.098916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.113350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14de345-126c-493e-8c8c-617d23e3e321 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.119368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b81ba-09a1-40cb-abac-5fba0a1fd3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.120074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b81ba-09a1-40cb-abac-5fba0a1fd3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.120647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b81ba-09a1-40cb-abac-5fba0a1fd3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.120647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b81ba-09a1-40cb-abac-5fba0a1fd3fe admin admin] PATH_INFO: `/v3/projects/001f602906d345ddbe38bcc8fa02ad72/users/9d586c79ae4e4a7fa6b8944a0a5152d3/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.123105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b81ba-09a1-40cb-abac-5fba0a1fd3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=001f602906d345ddbe38bcc8fa02ad72, user_id=9d586c79ae4e4a7fa6b8944a0a5152d3, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.125807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b81ba-09a1-40cb-abac-5fba0a1fd3fe admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.138987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1041/2085] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:21 2022] PUT /identity/v3/projects/001f602906d345ddbe38bcc8fa02ad72/users/9d586c79ae4e4a7fa6b8944a0a5152d3/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:21.149191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f427e-ad59-4965-ab00-dc95b0e3625d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.150678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d464-f974-45ee-9369-88038594382c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.150998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d464-f974-45ee-9369-88038594382c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.152385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d464-f974-45ee-9369-88038594382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.181548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fe04d464-f974-45ee-9369-88038594382c None None] MFA Rules not processed for user `9d586c79ae4e4a7fa6b8944a0a5152d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:21.182799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fe04d464-f974-45ee-9369-88038594382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.224939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.225621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.225901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.226184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] PATH_INFO: `/v3/users/c64f97f557974463bea0d985cc9de324` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.227445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64f97f557974463bea0d985cc9de324)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.229453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.257489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1042/2086] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:21.270983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d464-f974-45ee-9369-88038594382c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.272624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fe04d464-f974-45ee-9369-88038594382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.291182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64f97f557974463bea0d985cc9de324'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.292241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64f97f557974463bea0d985cc9de324'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.299836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64f97f557974463bea0d985cc9de324'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.300570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64f97f557974463bea0d985cc9de324'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.309650 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a8c00eb4-9997-43cc-bbdd-9f266f7c8f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64f97f557974463bea0d985cc9de324'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.310844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:21.333393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1045/2087] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:21 2022] DELETE /identity/v3/users/c64f97f557974463bea0d985cc9de324 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:21.337828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d464-f974-45ee-9369-88038594382c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.338012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.338127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.338438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.362170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:21.363413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.390109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.391370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.391660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.391964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.393768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.422213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:21.433795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1046/2088] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:21.444745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.446644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.473186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.474666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.486593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1043/2089] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:21.517023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441f61f-8db0-46a6-890d-600d1dc5641e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.521664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.522338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.522624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.522895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.534111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.535696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.546593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1047/2090] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:21.575258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.576725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.587903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5ab8c-8c13-42db-aa35-cf0d95b912d6 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.591960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.592590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.593078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.593208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.594903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.662500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.664027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc828f-3f04-491e-8c95-194ce1853a52 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.675879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1044/2091] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:21.882545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.883693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.903639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94ad8e-5dcf-4501-8374-4f56e9c86741 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.909876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.910672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.910845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.911176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] PATH_INFO: `/v3/projects/7bd3f92e47e24d7684f7084b8283f3d8` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.912425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd3f92e47e24d7684f7084b8283f3d8)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.914663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.969490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd3f92e47e24d7684f7084b8283f3d8', 'request_id': 'req-1032b164-0b52-417b-8ebc-aae6efab541c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.974970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd3f92e47e24d7684f7084b8283f3d8', 'request_id': 'req-1032b164-0b52-417b-8ebc-aae6efab541c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.981952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd3f92e47e24d7684f7084b8283f3d8', 'request_id': 'req-1032b164-0b52-417b-8ebc-aae6efab541c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.995112 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] The token cache is being invalidate because project 7bd3f92e47e24d7684f7084b8283f3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:21.995534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.996177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1032b164-0b52-417b-8ebc-aae6efab541c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:21.997865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1048/2092] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:21 2022] DELETE /identity/v3/projects/7bd3f92e47e24d7684f7084b8283f3d8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:22.003792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.004237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.004606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.025907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:22.027491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:22.095087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1045/2093] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:22.105158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.105504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.105665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.123147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:22.130420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:22.132141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:22.141810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1049/2094] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:22.146342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.163675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9370a50-e9b4-4562-874e-d19c03e7b687 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.171873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.172513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.172792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.173068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.173758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:22.174091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.176037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.191106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1046/2095] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:22.197099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.215760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e04ca-7810-431a-b24a-0668fd62998b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.222412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.223086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.223383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.223682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.224411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.226454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.284180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1050/2096] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:22.288658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.301859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b28df3-cbc0-4f42-a13b-3e7e0e2bf4ec admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.375340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:22.410933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.410933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.410933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.410933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.411312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.411312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.442230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1047/2097] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:22.444189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.457497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3b8b6-a7d1-45d1-853b-bd856f98ca31 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.463080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.463850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.464166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.464491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.465315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.466985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.480198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1051/2098] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:22.485158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.495715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a532af-2251-4a13-b01b-8441fcf59c01 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.500774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b7cee-5bd6-408d-be36-ed80590fa16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.501456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b7cee-5bd6-408d-be36-ed80590fa16b admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.501791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b7cee-5bd6-408d-be36-ed80590fa16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.502126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b7cee-5bd6-408d-be36-ed80590fa16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.502855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b7cee-5bd6-408d-be36-ed80590fa16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.504920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b7cee-5bd6-408d-be36-ed80590fa16b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.524677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1048/2099] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:02:22.529120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.540639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851f74f-d9c2-4ac1-84b8-8a6c51992d04 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.546832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.547540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.547827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.548099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] PATH_INFO: `/v3/projects/dd8e49888a584263b80a5afb0921fe2a/users/db94e9424e1046f5a3a1aa4d261142f2/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.564225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8e49888a584263b80a5afb0921fe2a, user_id=db94e9424e1046f5a3a1aa4d261142f2, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.567259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.582141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1052/2100] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:22 2022] PUT /identity/v3/projects/dd8e49888a584263b80a5afb0921fe2a/users/db94e9424e1046f5a3a1aa4d261142f2/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:22.597688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.597962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.598121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.630496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] MFA Rules not processed for user `db94e9424e1046f5a3a1aa4d261142f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:22.632841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:22.745697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1049/2101] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:22.747718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.837198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88db4-eb32-44d4-89b6-65e22b4b426c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.842784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.843459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.843713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.844006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.844964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.847591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:22.889131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1053/2102] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:22.893378 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:22.907073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406d6c-ab32-43e1-99b1-fbd17f9329dd None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:22.987473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:22.988168 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:22.988447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:22.988742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:22.989414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:22.991414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.017964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1050/2103] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:22 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:23.023240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.037094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa70535-c38f-4a7d-b436-c75093a5f69d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.042970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.044159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.044452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.044718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.045381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.047092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.059329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1054/2104] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:23.063857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.076646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2daf0-f92a-4bd9-8c2f-514f3fbc710e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.087212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77c476-fe9f-48eb-bb56-6f111e9632fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.087856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77c476-fe9f-48eb-bb56-6f111e9632fe admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.088130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77c476-fe9f-48eb-bb56-6f111e9632fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.088413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77c476-fe9f-48eb-bb56-6f111e9632fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.089558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77c476-fe9f-48eb-bb56-6f111e9632fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.091888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77c476-fe9f-48eb-bb56-6f111e9632fe admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.112321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1051/2105] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:23.114794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.128443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdaff-f223-4bb2-84ea-323a86db92ed admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.133459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.134174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.134533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.134845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] PATH_INFO: `/v3/projects/0fd9dcbacac744b58974461532971da8/users/9b344ff20d3b4764865551a6cad542a1/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.153315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd9dcbacac744b58974461532971da8, user_id=9b344ff20d3b4764865551a6cad542a1, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.156178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.177730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1055/2106] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:23 2022] PUT /identity/v3/projects/0fd9dcbacac744b58974461532971da8/users/9b344ff20d3b4764865551a6cad542a1/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:23.188725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.189691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.189910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.230154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] MFA Rules not processed for user `9b344ff20d3b4764865551a6cad542a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:23.230946 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:23.252884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:23.321984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1052/2107] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:23.324042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.394492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:23.414087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9282b-f2b3-4ed8-ba7e-a70f72d7db3f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.424431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.425064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.425345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.425615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.426397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.428507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.471694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.478118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1056/2108] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:23 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:23.485558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96736-0ec5-4da5-8c72-3b2aa00666d5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.570323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.571266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.571528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.571892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.573494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.575865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.628284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1053/2109] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:23 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:23.633034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.649605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0db047-f865-4817-92b9-6a4d064348bd admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.655840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.656469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.656750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.657022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.657686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.659562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.672146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1057/2110] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:02:23.677530 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.688255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc15023-0cde-45f4-a582-f82332da0207 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.692975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.693642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.693946 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.694241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] PATH_INFO: `/v3/projects/02638e171ca848a6b6b36d7caaf791b5/users/6b4eb048760c4909a4e934b84101baba/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.720390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02638e171ca848a6b6b36d7caaf791b5, user_id=6b4eb048760c4909a4e934b84101baba, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.725411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.741237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1054/2111] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:23 2022] PUT /identity/v3/projects/02638e171ca848a6b6b36d7caaf791b5/users/6b4eb048760c4909a4e934b84101baba/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:23.746201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.758959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e697a0-86b1-4f18-8f26-1c46a2b9e36b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.821736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b771c-7ab5-4018-b0ec-e3d8fcd7a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.822365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b771c-7ab5-4018-b0ec-e3d8fcd7a5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.822647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b771c-7ab5-4018-b0ec-e3d8fcd7a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.822992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b771c-7ab5-4018-b0ec-e3d8fcd7a5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.823728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b771c-7ab5-4018-b0ec-e3d8fcd7a5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.825382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b771c-7ab5-4018-b0ec-e3d8fcd7a5ba admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.844497 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1058/2112] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:02:23.845785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:23.857065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d32474-bbdf-4805-bd96-203d3555835e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:23.863104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:23.863894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.864191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.864483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] PATH_INFO: `/v3/projects/02638e171ca848a6b6b36d7caaf791b5/users/6b4eb048760c4909a4e934b84101baba/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.866569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02638e171ca848a6b6b36d7caaf791b5, user_id=6b4eb048760c4909a4e934b84101baba, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:23.869384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:23.881098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1055/2113] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:23 2022] PUT /identity/v3/projects/02638e171ca848a6b6b36d7caaf791b5/users/6b4eb048760c4909a4e934b84101baba/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:23.893502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:23.893720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:23.894001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:23.925535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] MFA Rules not processed for user `6b4eb048760c4909a4e934b84101baba`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:23.926851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:24.011069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1059/2114] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:24.023625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:24.025457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:24.090517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac21b0-ce06-4dc9-b76a-0df3b0710a63 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:24.095519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76ce7-8a27-42c3-80e5-4b13a78827fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:24.096323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76ce7-8a27-42c3-80e5-4b13a78827fb service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:24.096608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76ce7-8a27-42c3-80e5-4b13a78827fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:24.096879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76ce7-8a27-42c3-80e5-4b13a78827fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:24.130797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:24.167919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c76ce7-8a27-42c3-80e5-4b13a78827fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:24.169405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c76ce7-8a27-42c3-80e5-4b13a78827fb service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:24.180238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1056/2115] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:24.649695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:24.651228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:24.721171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:24.741190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df4d43-c21c-4bde-a0d8-64145c5c36ca None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:24.746764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:24.747487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:24.747750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:24.748030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] PATH_INFO: `/v3/users/5cafbe35a93245e3963c656e2a519b92` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:24.749325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cafbe35a93245e3963c656e2a519b92)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:24.751319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:24.819796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cafbe35a93245e3963c656e2a519b92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:24.820479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cafbe35a93245e3963c656e2a519b92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:24.828791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cafbe35a93245e3963c656e2a519b92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:24.829694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cafbe35a93245e3963c656e2a519b92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:24.837554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cafbe35a93245e3963c656e2a519b92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:24.856261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1060/2116] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:24 2022] DELETE /identity/v3/users/5cafbe35a93245e3963c656e2a519b92 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:24.865297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:24.865583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:24.865853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:24.886591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:24.887832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:24.967586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1057/2117] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:24.977574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:24.978870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:25.046394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f690-30f3-4e1a-870b-d11178ccabf4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:25.050633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:25.051309 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:25.051588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:25.051856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:25.063066 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:25.064630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:25.076123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1061/2118] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:25.399577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:25.401304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:25.414480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7e7f-8fdc-4788-b383-dd9bb0bf4484 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:25.420702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:25.421394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:25.421674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:25.421949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] PATH_INFO: `/v3/projects/f9cdfb0231bc4f1fa458e50fa02f6e17` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:25.423250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cdfb0231bc4f1fa458e50fa02f6e17)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:25.425228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:25.482828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cdfb0231bc4f1fa458e50fa02f6e17', 'request_id': 'req-13273e3f-ac96-4a1b-9537-c095af534e7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.489548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cdfb0231bc4f1fa458e50fa02f6e17', 'request_id': 'req-13273e3f-ac96-4a1b-9537-c095af534e7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.496277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cdfb0231bc4f1fa458e50fa02f6e17', 'request_id': 'req-13273e3f-ac96-4a1b-9537-c095af534e7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.510222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] The token cache is being invalidate because project f9cdfb0231bc4f1fa458e50fa02f6e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:25.510696 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.511411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.512974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1058/2119] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:25 2022] DELETE /identity/v3/projects/f9cdfb0231bc4f1fa458e50fa02f6e17 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:25.517546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:25.528747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef42df-c63d-435a-85f8-8f6e57880209 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:25.595845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:25.596741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:25.597203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:25.597534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] PATH_INFO: `/v3/users/9d586c79ae4e4a7fa6b8944a0a5152d3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:25.598609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d586c79ae4e4a7fa6b8944a0a5152d3)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:25.600772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:25.616317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:25.660698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d586c79ae4e4a7fa6b8944a0a5152d3'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.661810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d586c79ae4e4a7fa6b8944a0a5152d3'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.672999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d586c79ae4e4a7fa6b8944a0a5152d3'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.673717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d586c79ae4e4a7fa6b8944a0a5152d3'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.681485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d586c79ae4e4a7fa6b8944a0a5152d3'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:25.708769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1062/2120] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:25 2022] DELETE /identity/v3/users/9d586c79ae4e4a7fa6b8944a0a5152d3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:25.778003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:25.779480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:25.855098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273e3f-ac96-4a1b-9537-c095af534e7c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:25.861619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:25.939453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:25.940092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:25.940371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:25.940729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:25.942549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:26.086385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.088328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19429-4c6a-476e-a9a6-da73b8305248 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.100851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1059/2121] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:26.190278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.192155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:26.294377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d32a-8bba-46bf-9cba-ec9b119bb12a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.300186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:26.300966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.301247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.301520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] PATH_INFO: `/v3/projects/001f602906d345ddbe38bcc8fa02ad72` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.306244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] RBAC: Authorizing `identity:delete_project(project_id=001f602906d345ddbe38bcc8fa02ad72)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.308461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.370951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001f602906d345ddbe38bcc8fa02ad72', 'request_id': 'req-66936e8c-efb5-4494-8e1a-ec51aa98792b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:26.380813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001f602906d345ddbe38bcc8fa02ad72', 'request_id': 'req-66936e8c-efb5-4494-8e1a-ec51aa98792b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:26.390621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001f602906d345ddbe38bcc8fa02ad72', 'request_id': 'req-66936e8c-efb5-4494-8e1a-ec51aa98792b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:26.411138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] The token cache is being invalidate because project 001f602906d345ddbe38bcc8fa02ad72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:26.411505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:26.412686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-66936e8c-efb5-4494-8e1a-ec51aa98792b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:26.414649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1063/2122] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:26 2022] DELETE /identity/v3/projects/001f602906d345ddbe38bcc8fa02ad72 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:26.419717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.420242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.420406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.455192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:26.456647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:26.532632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1060/2123] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:26.540764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.541338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.541628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.566981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:26.568271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:26.580393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1064/2124] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:26.585446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.598793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fb296-999c-44e2-a3c2-afd7e4b8da52 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.606149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:26.607012 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.607464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.608070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.608802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:26.609096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.611332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.627860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1061/2125] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:26.629040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.641623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8f66-1c2b-4703-8755-e5c7fe66257b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.648719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:26.649546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.650006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.650476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.651264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.653618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.671940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:26.698743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1065/2126] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:26 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:26.703871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.717240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d485fc-9c9f-4ff8-a390-2b4decb69a32 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.791602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:26.807893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:26.808629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.808916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.809198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.809850 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.812730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.855482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1062/2127] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:26 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:26.856655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.869961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46ad1-fe94-4e19-9772-2a1c2a696ea4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.884313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:26.884971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.885218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.885538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.886204 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.888031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.900942 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1066/2128] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:26.905431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.934355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d219-575f-4e69-9a8e-11f088a338bb admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.940945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:26.941652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:26.941996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:26.942340 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:26.943084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:26.944853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:26.964359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1063/2129] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:26.968369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.982600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:26.985341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6cf91-7fff-4485-a9bf-550e33f7d971 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:26.986948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:27.000857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f3463-dea0-4f0b-b9a8-3d0962175c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.002223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f3463-dea0-4f0b-b9a8-3d0962175c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.003256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f3463-dea0-4f0b-b9a8-3d0962175c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.003533 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f3463-dea0-4f0b-b9a8-3d0962175c00 admin admin] PATH_INFO: `/v3/projects/584f5d3effd34f2e86859567b057c882/users/7d4d2072a4be4cfc90ee2bf4665516e2/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.021845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f3463-dea0-4f0b-b9a8-3d0962175c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584f5d3effd34f2e86859567b057c882, user_id=7d4d2072a4be4cfc90ee2bf4665516e2, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.025280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f3463-dea0-4f0b-b9a8-3d0962175c00 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.041819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1067/2130] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:26 2022] PUT /identity/v3/projects/584f5d3effd34f2e86859567b057c882/users/7d4d2072a4be4cfc90ee2bf4665516e2/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:27.054633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.055024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.055395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.083516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815db5a4-b108-4b71-8720-87ffa7d200e5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.110855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] MFA Rules not processed for user `7d4d2072a4be4cfc90ee2bf4665516e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:27.112230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:27.149813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.150487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.151024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.151703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.157998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:27.207676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1068/2131] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:27.212320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.320205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5bf6-dcb3-4037-be22-80b2bed5b2dd None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.325764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.326361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.326639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.326907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.327149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.327655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.328751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.329608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.340689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1064/2132] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:27.366502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1069/2133] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:27 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:27.368040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.380098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ef1f-e64a-47f6-80a2-9509274f20df service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.419894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:27.450331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.450526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.450677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.450921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.451588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.453521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.475810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1065/2134] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:27 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:27.480264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.491178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c6f89-364e-43b8-aead-67a51e1336b1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.497486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.498132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.498395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.498688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.499526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.501109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.512450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1070/2135] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:27.518484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.532263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064380-09ee-491b-a89b-ecf28797901d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.538317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.538929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.539242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.539514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] PATH_INFO: `/v3/projects/10c4b4f6d0e143bba0fbc4e970bf4b66/users/a37e2c9ea941402f9422fd682797419e/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.556826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c4b4f6d0e143bba0fbc4e970bf4b66, user_id=a37e2c9ea941402f9422fd682797419e, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.559833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.573892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1066/2136] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:27 2022] PUT /identity/v3/projects/10c4b4f6d0e143bba0fbc4e970bf4b66/users/a37e2c9ea941402f9422fd682797419e/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:27.578226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.589285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988579b6-45a4-400c-ab28-1cb3160ac209 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.615875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:27.662820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfb4f1-93f3-496a-8850-09e40f21574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.663693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfb4f1-93f3-496a-8850-09e40f21574f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.664015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfb4f1-93f3-496a-8850-09e40f21574f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.664352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfb4f1-93f3-496a-8850-09e40f21574f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.665047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfb4f1-93f3-496a-8850-09e40f21574f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.667628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfb4f1-93f3-496a-8850-09e40f21574f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.678304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1071/2137] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:27.683184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.693893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef286a-106b-4c13-88a2-1eef3ad1bfc7 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.698771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.699682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.700216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.700653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] PATH_INFO: `/v3/projects/10c4b4f6d0e143bba0fbc4e970bf4b66/users/a37e2c9ea941402f9422fd682797419e/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.702771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c4b4f6d0e143bba0fbc4e970bf4b66, user_id=a37e2c9ea941402f9422fd682797419e, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.705478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.717556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1067/2138] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:27 2022] PUT /identity/v3/projects/10c4b4f6d0e143bba0fbc4e970bf4b66/users/a37e2c9ea941402f9422fd682797419e/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:27.728302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.728725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.729035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.759486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] MFA Rules not processed for user `a37e2c9ea941402f9422fd682797419e`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:27.760837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:27.840397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1072/2139] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:27.851419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.853143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:27.918510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517099-744e-407c-a648-85c77aed0d90 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.922783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.923479 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.923719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.923961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.990638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.992128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:28.002228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1068/2140] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:30.706624 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:30.719339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d1540-6ec0-4af4-a7d7-70a35a039605 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:30.722867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf2de-d1b9-4d47-9845-775c9074cbfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:30.726495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf2de-d1b9-4d47-9845-775c9074cbfb service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:30.726807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf2de-d1b9-4d47-9845-775c9074cbfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:30.727094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf2de-d1b9-4d47-9845-775c9074cbfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:30.742626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bf2de-d1b9-4d47-9845-775c9074cbfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:30.744102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bf2de-d1b9-4d47-9845-775c9074cbfb service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:30.759218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1073/2141] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:31.386810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:31.388660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:31.442306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:31.472631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829bc9d-ee27-47bc-823a-ec7bec4fe1df service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:31.477375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:31.478027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:31.478306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:31.478577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] PATH_INFO: `/v3/users/db94e9424e1046f5a3a1aa4d261142f2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:31.480124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db94e9424e1046f5a3a1aa4d261142f2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:31.482623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:31.534718 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db94e9424e1046f5a3a1aa4d261142f2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:31.535523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db94e9424e1046f5a3a1aa4d261142f2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:31.536116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db94e9424e1046f5a3a1aa4d261142f2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:31.543908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db94e9424e1046f5a3a1aa4d261142f2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:31.551414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db94e9424e1046f5a3a1aa4d261142f2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:31.568354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1069/2142] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:31 2022] DELETE /identity/v3/users/db94e9424e1046f5a3a1aa4d261142f2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:31.572818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:31.573099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:31.573532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:31.592691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:31.593888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:31.659129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1074/2143] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:31.669632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:31.671402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:31.732552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d80362-4af9-461f-9d72-228dc8cc6867 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:31.736339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:31.736945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:31.737224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:31.737492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:31.747252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:31.748683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:31.758623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1070/2144] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:32.143017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:32.145835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:32.173984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46fbe-e684-4dce-b7a4-9d701b10c41b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:32.198796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:32.199835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:32.200323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:32.200795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] PATH_INFO: `/v3/projects/dd8e49888a584263b80a5afb0921fe2a` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:32.202404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8e49888a584263b80a5afb0921fe2a)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:32.205151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:32.255179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:32.288140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8e49888a584263b80a5afb0921fe2a', 'request_id': 'req-1568d501-7478-42f7-8823-cc4fdf30b107'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.300051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8e49888a584263b80a5afb0921fe2a', 'request_id': 'req-1568d501-7478-42f7-8823-cc4fdf30b107'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.306944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8e49888a584263b80a5afb0921fe2a', 'request_id': 'req-1568d501-7478-42f7-8823-cc4fdf30b107'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.332900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] The token cache is being invalidate because project dd8e49888a584263b80a5afb0921fe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:32.333050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.333836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.338924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1075/2145] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:32 2022] DELETE /identity/v3/projects/dd8e49888a584263b80a5afb0921fe2a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:32.340629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:32.350651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2820-ae57-4c9f-8b1f-11089df1c37b service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:32.423311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:32.424231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:32.424231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:32.424431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] PATH_INFO: `/v3/users/9b344ff20d3b4764865551a6cad542a1` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:32.425549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b344ff20d3b4764865551a6cad542a1)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:32.427573 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:32.432489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:32.491396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b344ff20d3b4764865551a6cad542a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.492072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b344ff20d3b4764865551a6cad542a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.492710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b344ff20d3b4764865551a6cad542a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.504354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b344ff20d3b4764865551a6cad542a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.516991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b344ff20d3b4764865551a6cad542a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:32.540254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1071/2146] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:32 2022] DELETE /identity/v3/users/9b344ff20d3b4764865551a6cad542a1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:32.896781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:32.898372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:32.918249 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d501-7478-42f7-8823-cc4fdf30b107 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:32.996992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:32.997676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:32.998031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:32.998342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] PATH_INFO: `/v3/projects/0fd9dcbacac744b58974461532971da8` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:33.002270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd9dcbacac744b58974461532971da8)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:33.002270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:33.056823 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd9dcbacac744b58974461532971da8', 'request_id': 'req-6e09d534-e97c-4cd9-8771-d503e9e8de0c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.062928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd9dcbacac744b58974461532971da8', 'request_id': 'req-6e09d534-e97c-4cd9-8771-d503e9e8de0c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.069233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd9dcbacac744b58974461532971da8', 'request_id': 'req-6e09d534-e97c-4cd9-8771-d503e9e8de0c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.084516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] The token cache is being invalidate because project 0fd9dcbacac744b58974461532971da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:33.084812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.085471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.086958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1076/2147] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:32 2022] DELETE /identity/v3/projects/0fd9dcbacac744b58974461532971da8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:33.092434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:33.095429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:33.117355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea72305-e4f5-45f1-b432-a2ddaa911293 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:33.194450 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:33.195033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:33.195346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:33.195622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] PATH_INFO: `/v3/users/6b4eb048760c4909a4e934b84101baba` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:33.196761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4eb048760c4909a4e934b84101baba)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:33.198773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:33.259006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4eb048760c4909a4e934b84101baba'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.259658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4eb048760c4909a4e934b84101baba'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.260267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4eb048760c4909a4e934b84101baba'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.268297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4eb048760c4909a4e934b84101baba'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.279014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-3ca9809d-e34f-4c07-bb26-2657bf16fcf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4eb048760c4909a4e934b84101baba'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.313425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1072/2148] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:33 2022] DELETE /identity/v3/users/6b4eb048760c4909a4e934b84101baba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:33.762818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:33.764971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:33.784407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09d534-e97c-4cd9-8771-d503e9e8de0c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:33.831963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:33.854279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:33.855383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:33.856251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:33.857039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] PATH_INFO: `/v3/projects/02638e171ca848a6b6b36d7caaf791b5` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:33.858875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02638e171ca848a6b6b36d7caaf791b5)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:33.862289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:33.918973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02638e171ca848a6b6b36d7caaf791b5', 'request_id': 'req-b9da0c6f-dc76-425b-a88a-19127173e105'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.924806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02638e171ca848a6b6b36d7caaf791b5', 'request_id': 'req-b9da0c6f-dc76-425b-a88a-19127173e105'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.931307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02638e171ca848a6b6b36d7caaf791b5', 'request_id': 'req-b9da0c6f-dc76-425b-a88a-19127173e105'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.946160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] The token cache is being invalidate because project 02638e171ca848a6b6b36d7caaf791b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:33.946564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.947415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9da0c6f-dc76-425b-a88a-19127173e105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:33.949169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1077/2149] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:33 2022] DELETE /identity/v3/projects/02638e171ca848a6b6b36d7caaf791b5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:37.990187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:37.990778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:37.990778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:38.000846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:38.017005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] MFA Rules not processed for user `9579f6a06b1743039bb5c3db8e88e460`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:38.018902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:38.086680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1073/2150] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:43.942638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:44.032101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3b6a9-2108-4036-94b3-441f44bc5c5d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:44.032392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3b6a9-2108-4036-94b3-441f44bc5c5d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:44.032675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3b6a9-2108-4036-94b3-441f44bc5c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:44.052577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ffd3b6a9-2108-4036-94b3-441f44bc5c5d None None] MFA Rules not processed for user `cf76e4d108e140508be72bd1afd5ca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:44.053794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ffd3b6a9-2108-4036-94b3-441f44bc5c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:44.091373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:44.093061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:44.117346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1078/2151] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:44.159868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4cb74-7586-4a5a-a79e-c52dfc79c016 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:44.164744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:44.165361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:44.165668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:44.166004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] PATH_INFO: `/v3/users/7d4d2072a4be4cfc90ee2bf4665516e2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:44.167285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4d2072a4be4cfc90ee2bf4665516e2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:44.169548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:44.228155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4d2072a4be4cfc90ee2bf4665516e2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:44.228818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4d2072a4be4cfc90ee2bf4665516e2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:44.229422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4d2072a4be4cfc90ee2bf4665516e2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:44.237346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4d2072a4be4cfc90ee2bf4665516e2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:44.247173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4d2072a4be4cfc90ee2bf4665516e2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:44.268881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1074/2152] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:44 2022] DELETE /identity/v3/users/7d4d2072a4be4cfc90ee2bf4665516e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:44.272226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:44.272548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:44.272819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:44.295262 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:44.296670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:44.385207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1079/2153] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:44.394636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:44.396090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:44.427819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:44.458707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ce5c4-77cf-4c52-90a3-4467830eb15d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:44.463189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:44.463723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:44.464137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:44.464468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:44.476439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:44.477609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:44.488645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1075/2154] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:44.869432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:44.871846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:44.890895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d4ed5-059e-4bf9-806a-eab7e31e6a51 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:44.926655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:44.927475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:44.927764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:44.928038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] PATH_INFO: `/v3/projects/584f5d3effd34f2e86859567b057c882` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:44.929323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=584f5d3effd34f2e86859567b057c882)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:44.931426 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:45.016163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584f5d3effd34f2e86859567b057c882', 'request_id': 'req-b1a6cefd-8d36-446d-a94d-0903c154e98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.026471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584f5d3effd34f2e86859567b057c882', 'request_id': 'req-b1a6cefd-8d36-446d-a94d-0903c154e98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.034610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584f5d3effd34f2e86859567b057c882', 'request_id': 'req-b1a6cefd-8d36-446d-a94d-0903c154e98e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.049498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] The token cache is being invalidate because project 584f5d3effd34f2e86859567b057c882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:45.049886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.050607 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.052452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1080/2155] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:44 2022] DELETE /identity/v3/projects/584f5d3effd34f2e86859567b057c882 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:45.056391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:45.075241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d5cd-3d11-403a-b918-a50137b10fa9 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:45.135584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:45.137095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:45.137551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:45.137829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] PATH_INFO: `/v3/users/a37e2c9ea941402f9422fd682797419e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:45.139195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37e2c9ea941402f9422fd682797419e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:45.141105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:45.198651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37e2c9ea941402f9422fd682797419e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.199886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37e2c9ea941402f9422fd682797419e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.200939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37e2c9ea941402f9422fd682797419e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.221372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37e2c9ea941402f9422fd682797419e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.233429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b23dba9a-e26b-45ed-af7a-d49b83d405db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37e2c9ea941402f9422fd682797419e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.252406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1076/2156] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:45 2022] DELETE /identity/v3/users/a37e2c9ea941402f9422fd682797419e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:45.718093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:45.719529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:45.733010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6cefd-8d36-446d-a94d-0903c154e98e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:45.761599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:45.793730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:45.794279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:45.794569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:45.794814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] PATH_INFO: `/v3/projects/10c4b4f6d0e143bba0fbc4e970bf4b66` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:45.795955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c4b4f6d0e143bba0fbc4e970bf4b66)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:45.797882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:45.850080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c4b4f6d0e143bba0fbc4e970bf4b66', 'request_id': 'req-bc168cce-9a74-48be-b6de-bdf19a797f83'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.858272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c4b4f6d0e143bba0fbc4e970bf4b66', 'request_id': 'req-bc168cce-9a74-48be-b6de-bdf19a797f83'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.866714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c4b4f6d0e143bba0fbc4e970bf4b66', 'request_id': 'req-bc168cce-9a74-48be-b6de-bdf19a797f83'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.882629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] The token cache is being invalidate because project 10c4b4f6d0e143bba0fbc4e970bf4b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:45.882926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.883683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bc168cce-9a74-48be-b6de-bdf19a797f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:45.885340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1081/2157] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:45 2022] DELETE /identity/v3/projects/10c4b4f6d0e143bba0fbc4e970bf4b66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:45.891202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:45.891493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:45.891777 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:45.913810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:45.915020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:45.966096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:45.984653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1077/2158] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:45.992935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5349-d970-4210-879f-7756e70be689 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:45.993201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5349-d970-4210-879f-7756e70be689 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:45.993506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5349-d970-4210-879f-7756e70be689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.029723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b32f5349-d970-4210-879f-7756e70be689 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:46.030983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b32f5349-d970-4210-879f-7756e70be689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:46.048592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1082/2159] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:46.049509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.061852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196805bf-782f-4a36-9356-5e5d281814ba None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.068509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.069390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.069841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.070299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.071100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:46.071563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.073820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:46.099394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1078/2160] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:46.100678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f5349-d970-4210-879f-7756e70be689 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.113723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f5349-d970-4210-879f-7756e70be689 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.129174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.130018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.130449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.130873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.133291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.139744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:46.213957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1083/2161] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:46 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:46.217810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.237675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77dc65-e1ea-40d2-ad19-852a6d5a0863 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.383231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.390484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.390774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.391084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.391729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.397494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:46.446240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1079/2162] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:46 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:46.452297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.471943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddca27-1690-4ed4-90f4-c63fffef6d0a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.485777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.486412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.487381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.487665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.488336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.493634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:46.523299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1084/2163] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:46.528531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.543663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307bff-cb37-45ef-a240-f10e396e53c1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.553294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fda7f-7d38-46ea-924d-75f59f6ae2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.555292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fda7f-7d38-46ea-924d-75f59f6ae2ef admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.555584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fda7f-7d38-46ea-924d-75f59f6ae2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.556079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fda7f-7d38-46ea-924d-75f59f6ae2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.556925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fda7f-7d38-46ea-924d-75f59f6ae2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.560824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fda7f-7d38-46ea-924d-75f59f6ae2ef admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:46.580084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1080/2164] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:46.581892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.595740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477768ca-2375-45a2-86a0-397f8c49adf8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.602907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.603629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.603914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.604907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] PATH_INFO: `/v3/projects/c4dde74389c8484b838bd2bbc23a1653/users/ce845a7d40e74cbcbd10fb77751baa69/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.643905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dde74389c8484b838bd2bbc23a1653, user_id=ce845a7d40e74cbcbd10fb77751baa69, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.646623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:46.683354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1085/2165] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:46 2022] PUT /identity/v3/projects/c4dde74389c8484b838bd2bbc23a1653/users/ce845a7d40e74cbcbd10fb77751baa69/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:46.694620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.695475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.695475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.736189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] MFA Rules not processed for user `ce845a7d40e74cbcbd10fb77751baa69`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:46.737841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:46.909638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1081/2166] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:46.914848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:46.977693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:46.984647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9f73-6743-422a-8bec-cf2d5d0cea10 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:46.991329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:46.992073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:46.992423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:46.992765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:46.993475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:46.995658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.027587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1086/2167] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:46 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:47.032249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.043856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da45d4-574b-4902-abdb-289e66f1910c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.125789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:47.148127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.148929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.149335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.149704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.151960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.154873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.201146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1082/2168] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:47 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:47.205486 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.229291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f03ad0-516f-4c73-a18d-775ce18644d5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.234766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.236386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.236514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.236939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.237796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.239728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.269630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1087/2169] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:47.273760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.285720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e9ef-3929-49db-b655-cecceb964c6b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.303343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.304037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.304332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.304629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] PATH_INFO: `/v3/projects/c4fb203622c9488191b230f028b15435/users/61cf63378d0a4359958aa459e393d7dc/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.344382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fb203622c9488191b230f028b15435, user_id=61cf63378d0a4359958aa459e393d7dc, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.347372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.362679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1083/2170] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:47 2022] PUT /identity/v3/projects/c4fb203622c9488191b230f028b15435/users/61cf63378d0a4359958aa459e393d7dc/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:47.366950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.377803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738636d-aac8-4202-9906-cbc7d48b8c42 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.445016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba02565-9b34-4454-b5d8-872cc7d1d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.445628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba02565-9b34-4454-b5d8-872cc7d1d485 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.445911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba02565-9b34-4454-b5d8-872cc7d1d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.446181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba02565-9b34-4454-b5d8-872cc7d1d485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.447036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba02565-9b34-4454-b5d8-872cc7d1d485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.448893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba02565-9b34-4454-b5d8-872cc7d1d485 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.464498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1088/2171] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:47.465756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.478031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e08-a187-44a2-8ae8-0a8b21d7eeb0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.484206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.484904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.485236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.485236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] PATH_INFO: `/v3/projects/c4fb203622c9488191b230f028b15435/users/61cf63378d0a4359958aa459e393d7dc/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.488091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fb203622c9488191b230f028b15435, user_id=61cf63378d0a4359958aa459e393d7dc, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.490727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.506811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1084/2172] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:47 2022] PUT /identity/v3/projects/c4fb203622c9488191b230f028b15435/users/61cf63378d0a4359958aa459e393d7dc/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:47.520180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.520430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.520735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.555244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] MFA Rules not processed for user `61cf63378d0a4359958aa459e393d7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:47.556501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:47.637842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1089/2173] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:47.649180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.651079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:47.717585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e890d1-49ff-4c7d-812c-58e1283b1bfe admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.721561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.722182 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.722461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.722736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.733380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.734849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.747471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1085/2174] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:47.805790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.807523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:47.821813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b249a0-039e-4eab-9af6-04ffa89f1e61 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.826522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.827183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.827456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.827744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.893191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:47.906661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.908358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.932040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1090/2175] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:51.560863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:51.562600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:51.600873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:51.638139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf743b-137a-4aeb-abe4-2f316f3e1bb3 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:51.642915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:51.643794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:51.644253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:51.644596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] PATH_INFO: `/v3/users/c057d06320dc4b6baef787a117fbfd7c` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:51.646035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c057d06320dc4b6baef787a117fbfd7c)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:51.647968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:51.669885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478bd48-edd8-40d9-b610-01c83c8286f3 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:51.674507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:51.675185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:51.675470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:51.675746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] PATH_INFO: `/v3/users/ce845a7d40e74cbcbd10fb77751baa69` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:51.676879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce845a7d40e74cbcbd10fb77751baa69)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:51.678891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:51.709511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:51.717149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c057d06320dc4b6baef787a117fbfd7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.718270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c057d06320dc4b6baef787a117fbfd7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.719161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c057d06320dc4b6baef787a117fbfd7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.730292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c057d06320dc4b6baef787a117fbfd7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.738293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b16a37ba-e101-48e9-898e-4c2186bf55e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c057d06320dc4b6baef787a117fbfd7c'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.740199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce845a7d40e74cbcbd10fb77751baa69'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.740893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce845a7d40e74cbcbd10fb77751baa69'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.750187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce845a7d40e74cbcbd10fb77751baa69'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.751089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce845a7d40e74cbcbd10fb77751baa69'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.758894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-1f028875-d991-4826-9174-f947dc668736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce845a7d40e74cbcbd10fb77751baa69'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:51.759613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1086/2176] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:51 2022] DELETE /identity/v3/users/c057d06320dc4b6baef787a117fbfd7c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:51.763994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:51.764522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:51.765003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:51.781365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1091/2177] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:51 2022] DELETE /identity/v3/users/ce845a7d40e74cbcbd10fb77751baa69 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:51.785284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:51.785661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:51.785949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:51.786225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:51.786788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:51.809239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:51.810771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:51.859640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1087/2178] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:51.869480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:51.871317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:51.889674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1092/2179] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:51.899586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:51.901038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:51.912331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:51.944216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa95b-d1f4-4d03-a52e-00e7d63b6c53 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:51.948268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:51.949079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:51.949356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:51.949656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:51.961824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:51.963428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:51.970404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34b512-c63f-41a9-b4fe-00bd98cd07d4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:51.974490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d58228-66d2-4678-988e-a7ea31a1b5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:51.975176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d58228-66d2-4678-988e-a7ea31a1b5ea service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:51.975465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d58228-66d2-4678-988e-a7ea31a1b5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:51.975741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d58228-66d2-4678-988e-a7ea31a1b5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:51.977045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1088/2180] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:51.986653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d58228-66d2-4678-988e-a7ea31a1b5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:51.988163 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d58228-66d2-4678-988e-a7ea31a1b5ea service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:52.000501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1093/2181] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:52.470451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:52.472097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:52.486160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aa9e0-6170-40a9-8894-9ca5e735da84 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:52.490947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:52.492002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.492352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.492692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] PATH_INFO: `/v3/projects/a46a23390d864d1b8436bb53fb47e64f` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.494030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46a23390d864d1b8436bb53fb47e64f)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:52.496604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:52.558401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46a23390d864d1b8436bb53fb47e64f', 'request_id': 'req-1d109a5a-232b-4d35-8993-3777202589af'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.571326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46a23390d864d1b8436bb53fb47e64f', 'request_id': 'req-1d109a5a-232b-4d35-8993-3777202589af'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.574187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:52.580310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46a23390d864d1b8436bb53fb47e64f', 'request_id': 'req-1d109a5a-232b-4d35-8993-3777202589af'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.598142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] The token cache is being invalidate because project a46a23390d864d1b8436bb53fb47e64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:52.598464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.599250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.601066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1089/2182] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:52 2022] DELETE /identity/v3/projects/a46a23390d864d1b8436bb53fb47e64f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:52.606056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a79f4-848a-42ed-bd55-ae559149ecf0 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.606600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a79f4-848a-42ed-bd55-ae559149ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.606825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a79f4-848a-42ed-bd55-ae559149ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.623715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:52.625627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:52.632401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-538a79f4-848a-42ed-bd55-ae559149ecf0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:52.634165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-538a79f4-848a-42ed-bd55-ae559149ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:52.700005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109a5a-232b-4d35-8993-3777202589af admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:52.705999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:52.706780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.707151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.707809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] PATH_INFO: `/v3/projects/c4dde74389c8484b838bd2bbc23a1653` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.709021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dde74389c8484b838bd2bbc23a1653)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:52.711217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:52.726468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1094/2183] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:52.735774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.736183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.736461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.768520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:52.770355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:52.779013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dde74389c8484b838bd2bbc23a1653', 'request_id': 'req-539921ea-f4bb-402d-a05b-e8c22bff7650'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.787713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dde74389c8484b838bd2bbc23a1653', 'request_id': 'req-539921ea-f4bb-402d-a05b-e8c22bff7650'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.795958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dde74389c8484b838bd2bbc23a1653', 'request_id': 'req-539921ea-f4bb-402d-a05b-e8c22bff7650'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.813506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] The token cache is being invalidate because project c4dde74389c8484b838bd2bbc23a1653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:52.814050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.814917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.817014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1090/2184] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:52 2022] DELETE /identity/v3/projects/c4dde74389c8484b838bd2bbc23a1653 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:52.820999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:52.822695 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:52.853139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1095/2185] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:52.858670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:52.869161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9678f-db6c-4d68-b4b7-109c8d327749 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:52.874261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:52.874890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.875277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.875586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.876211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:52.876668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:52.878314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:52.891951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1096/2186] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:52.896362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:52.908469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880c14-347d-4dda-bc97-d2098fb55622 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:52.910574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539921ea-f4bb-402d-a05b-e8c22bff7650 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:52.913484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:52.914159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.914442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.914718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.915379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:52.915963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:52.917354 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:52.917491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.917788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.918129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] PATH_INFO: `/v3/users/61cf63378d0a4359958aa459e393d7dc` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.919422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cf63378d0a4359958aa459e393d7dc)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:52.921715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:52.943019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:52.957805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1097/2187] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:52 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:02:52.959397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:52.980096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:52.982308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cf63378d0a4359958aa459e393d7dc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.982713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cf63378d0a4359958aa459e393d7dc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.984160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cf63378d0a4359958aa459e393d7dc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:52.994295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cf63378d0a4359958aa459e393d7dc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.003429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cf63378d0a4359958aa459e393d7dc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.023238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1091/2188] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:02:52 2022] DELETE /identity/v3/users/61cf63378d0a4359958aa459e393d7dc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:02:53.033683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64396ff7-fb94-4143-a6b3-4a5c0666b248 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.105472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.106260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.106579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.106974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.108000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.109733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.139343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1098/2189] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:52 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:02:53.141274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.143258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.163615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3f23c-9af2-462b-a6de-6c864d0e74f3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.171039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.172034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.172826 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.173351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.174155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.176487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.195300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1092/2190] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:02:53.196562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.215806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a67d9c-59fe-4329-8459-94432e93a720 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.220898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38b977-1690-4655-b861-cdc0a2c6ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.221524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b977-1690-4655-b861-cdc0a2c6ac88 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.221807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b977-1690-4655-b861-cdc0a2c6ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.222080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38b977-1690-4655-b861-cdc0a2c6ac88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.222736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38b977-1690-4655-b861-cdc0a2c6ac88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.224567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38b977-1690-4655-b861-cdc0a2c6ac88 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.236540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1099/2191] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:02:53.240801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.253733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39743608-9826-4f18-85cb-ea9cbcfa22b3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.259483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.260039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.260351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.260619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] PATH_INFO: `/v3/projects/a4b873e3a2994ef7b639b55c5ac6a564/users/aa61006c860a40209a136d0c655f4b0e/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.283852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b873e3a2994ef7b639b55c5ac6a564, user_id=aa61006c860a40209a136d0c655f4b0e, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.287762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.308317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1093/2192] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:53 2022] PUT /identity/v3/projects/a4b873e3a2994ef7b639b55c5ac6a564/users/aa61006c860a40209a136d0c655f4b0e/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:53.319815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.320230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.320599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.352767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.357688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.364839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] MFA Rules not processed for user `aa61006c860a40209a136d0c655f4b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:53.366151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.453439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1100/2193] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:53.464539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.464828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fa209-6139-4b84-8286-de26536bc3ff admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.466547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.471083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.471866 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.472247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.472614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] PATH_INFO: `/v3/projects/c4fb203622c9488191b230f028b15435` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.473856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fb203622c9488191b230f028b15435)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.476311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.532697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:53.549892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fb203622c9488191b230f028b15435', 'request_id': 'req-ad481887-c6c1-4382-922b-d0a4502f3d2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.564691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fb203622c9488191b230f028b15435', 'request_id': 'req-ad481887-c6c1-4382-922b-d0a4502f3d2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.570097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c2a6f-f64d-4313-8e0c-620a60c8b394 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.576129 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:53.578629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fb203622c9488191b230f028b15435', 'request_id': 'req-ad481887-c6c1-4382-922b-d0a4502f3d2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.601334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] The token cache is being invalidate because project c4fb203622c9488191b230f028b15435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:02:53.603387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.605121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-ad481887-c6c1-4382-922b-d0a4502f3d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:02:53.606929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1094/2194] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:02:53 2022] DELETE /identity/v3/projects/c4fb203622c9488191b230f028b15435 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:53.612080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44bd86-88f6-4649-9815-f21c2cd093e3 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.612648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44bd86-88f6-4649-9815-f21c2cd093e3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.613058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44bd86-88f6-4649-9815-f21c2cd093e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.639260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-db44bd86-88f6-4649-9815-f21c2cd093e3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:53.640980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-db44bd86-88f6-4649-9815-f21c2cd093e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.646454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.647260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.647546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.647818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.650519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.730626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1095/2195] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:53.739501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0cd3-b158-462a-8411-72e225609bea None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.740043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0cd3-b158-462a-8411-72e225609bea None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.740453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0cd3-b158-462a-8411-72e225609bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.749074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.753431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.764968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-894d0cd3-b158-462a-8411-72e225609bea None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:53.765953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1101/2196] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:53.767110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-894d0cd3-b158-462a-8411-72e225609bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:53.778144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1096/2197] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:53.779378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.800910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8423-49c2-4db0-9e14-c9e609c2689a service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.806143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.807095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.807357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.807614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.808277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:02:53.808587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.810189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.830391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1102/2198] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:02:53.834874 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0cd3-b158-462a-8411-72e225609bea None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.847601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0cd3-b158-462a-8411-72e225609bea None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:53.852773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:53.853626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:53.854197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:53.854865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:53.855782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:53.857917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:53.899619 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1097/2199] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:02:53 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:02:53.904252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:53.925272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7728b3-4efc-4a5a-8a00-e3a7ffe906fd admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:54.006290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:54.007166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.007398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.007719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:54.008478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:54.011034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:54.045777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1103/2200] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:02:53 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:02:54.050739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:54.064794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6167-fe85-464b-89f1-492a0d3af234 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:54.073117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:54.075563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.075927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.076321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:54.077074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:54.078888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:54.094830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1098/2201] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:54.096859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:54.108103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb174-a75d-450b-8a29-0e52d686553e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:54.113659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77613-b7cf-4f43-8bd5-80f68f8d27f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:54.114517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77613-b7cf-4f43-8bd5-80f68f8d27f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.114861 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77613-b7cf-4f43-8bd5-80f68f8d27f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.115190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77613-b7cf-4f43-8bd5-80f68f8d27f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:54.115852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77613-b7cf-4f43-8bd5-80f68f8d27f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:54.118114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77613-b7cf-4f43-8bd5-80f68f8d27f6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:54.137216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1104/2202] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:02:54.141371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:54.159109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56b6a-5c79-4737-9362-d435736b62b6 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:54.167167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:54.168166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.168598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.169040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] PATH_INFO: `/v3/projects/acdc143a41a6433b9cd249a884c86ed4/users/27e741952c6b42b2a5ecd9e2f2b70199/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:54.196577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdc143a41a6433b9cd249a884c86ed4, user_id=27e741952c6b42b2a5ecd9e2f2b70199, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:54.199712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:54.225632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1099/2203] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:02:54 2022] PUT /identity/v3/projects/acdc143a41a6433b9cd249a884c86ed4/users/27e741952c6b42b2a5ecd9e2f2b70199/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:02:54.231584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb63f-ae72-4e6b-bd31-8cae00de06a7 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.231869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb63f-ae72-4e6b-bd31-8cae00de06a7 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.232147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adb63f-ae72-4e6b-bd31-8cae00de06a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:54.255787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-d6adb63f-ae72-4e6b-bd31-8cae00de06a7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:54.257068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d6adb63f-ae72-4e6b-bd31-8cae00de06a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:54.261695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:54.325664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1105/2204] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:54.338907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:54.341098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:54.424238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa877-ad6a-4215-bdf5-1a3f97ec7525 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:54.428116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:54.428885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.429166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.429443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:54.441801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:54.443307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:54.456334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1100/2205] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:54.969200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651fbb-676c-4e5a-80cc-54abfb0f9049 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:54.969694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651fbb-676c-4e5a-80cc-54abfb0f9049 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:54.969787 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651fbb-676c-4e5a-80cc-54abfb0f9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:55.006972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b1651fbb-676c-4e5a-80cc-54abfb0f9049 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:55.010495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b1651fbb-676c-4e5a-80cc-54abfb0f9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:55.108052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1106/2206] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:02:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:55.157598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:55.159833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:55.222625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:55.281133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bcc93-7341-4986-bf84-c72a910d1462 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:55.287199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:55.288056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:55.288516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:55.288966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:55.301685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:55.303479 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:55.313542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1101/2207] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:02:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:02:55.367529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738c1e8-6d42-4abb-9e1b-c0a8d390e569 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:55.368051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738c1e8-6d42-4abb-9e1b-c0a8d390e569 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:55.368580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738c1e8-6d42-4abb-9e1b-c0a8d390e569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:55.438998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8738c1e8-6d42-4abb-9e1b-c0a8d390e569 None None] MFA Rules not processed for user `27e741952c6b42b2a5ecd9e2f2b70199`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:55.447709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8738c1e8-6d42-4abb-9e1b-c0a8d390e569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:55.585106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1107/2208] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:55.599675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:55.601222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:55.681072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58780-0836-443b-8b9e-cb377740a764 service swift] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:55.687082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:55.687773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:55.688052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:55.688317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:55.698468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:55.699951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:55.714976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1102/2209] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:57.156439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188204e-e313-4a4e-ac91-9fbc33e58c29 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:57.157832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188204e-e313-4a4e-ac91-9fbc33e58c29 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:57.158107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188204e-e313-4a4e-ac91-9fbc33e58c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:57.182132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7188204e-e313-4a4e-ac91-9fbc33e58c29 None None] MFA Rules not processed for user `27e741952c6b42b2a5ecd9e2f2b70199`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:57.183596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7188204e-e313-4a4e-ac91-9fbc33e58c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:57.191450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1108/2210] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:02:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:04.763397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:04.765097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:04.782585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774e21-f214-4c4a-8ecf-4c66c611a5f4 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:04.787609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:04.788259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:04.788567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:04.788836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] PATH_INFO: `/v3/users/aa61006c860a40209a136d0c655f4b0e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:04.790080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa61006c860a40209a136d0c655f4b0e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:04.792124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:04.898013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa61006c860a40209a136d0c655f4b0e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:04.898678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa61006c860a40209a136d0c655f4b0e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:04.899507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa61006c860a40209a136d0c655f4b0e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:04.912285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa61006c860a40209a136d0c655f4b0e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:04.922335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa61006c860a40209a136d0c655f4b0e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:04.948724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1103/2211] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:03:04 2022] DELETE /identity/v3/users/aa61006c860a40209a136d0c655f4b0e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:03:04.955123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:04.955123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:04.955123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:05.008297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:05.010830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:05.044996 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:05.084622 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1109/2212] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:05.095981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:05.097434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:05.136461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:05.177703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6a57d-d9ea-46fe-9eb8-61df8b42409d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:05.182633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ffeb-5e5a-4f04-8b44-bd3fae0221ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:05.183275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ffeb-5e5a-4f04-8b44-bd3fae0221ca service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:05.183602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ffeb-5e5a-4f04-8b44-bd3fae0221ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:05.184094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ffeb-5e5a-4f04-8b44-bd3fae0221ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:05.194315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ffeb-5e5a-4f04-8b44-bd3fae0221ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:05.196066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ffeb-5e5a-4f04-8b44-bd3fae0221ca service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:05.208700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1104/2213] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:05.621434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:05.623451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:05.643901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b33f7-e7a3-4dca-873b-9a759f4e03d1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:05.650044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:05.650375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:05.650801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:05.651176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] PATH_INFO: `/v3/projects/a4b873e3a2994ef7b639b55c5ac6a564` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:05.653232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b873e3a2994ef7b639b55c5ac6a564)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:05.656159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:05.718213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b873e3a2994ef7b639b55c5ac6a564', 'request_id': 'req-87665893-a26c-4305-9f9e-3c986c7959bd'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:05.724909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b873e3a2994ef7b639b55c5ac6a564', 'request_id': 'req-87665893-a26c-4305-9f9e-3c986c7959bd'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:05.733790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b873e3a2994ef7b639b55c5ac6a564', 'request_id': 'req-87665893-a26c-4305-9f9e-3c986c7959bd'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:05.751520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] The token cache is being invalidate because project a4b873e3a2994ef7b639b55c5ac6a564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:03:05.751520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:05.752358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-87665893-a26c-4305-9f9e-3c986c7959bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:05.776735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1110/2214] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:03:05 2022] DELETE /identity/v3/projects/a4b873e3a2994ef7b639b55c5ac6a564 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:03:11.025833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7924d-881c-40f3-a51b-bd28dd0f9fa5 None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.026433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7924d-881c-40f3-a51b-bd28dd0f9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.026433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7924d-881c-40f3-a51b-bd28dd0f9fa5 None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.027776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1105/2215] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:11.034797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee683f-ccb9-4b08-9b9a-87b209baec9d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.035606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee683f-ccb9-4b08-9b9a-87b209baec9d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.035606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee683f-ccb9-4b08-9b9a-87b209baec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.057733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ceee683f-ccb9-4b08-9b9a-87b209baec9d None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:11.058915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ceee683f-ccb9-4b08-9b9a-87b209baec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:11.137953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1111/2216] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:03:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:11.154376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7924d-881c-40f3-a51b-bd28dd0f9fa5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:11.156269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-55c7924d-881c-40f3-a51b-bd28dd0f9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:11.222932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7924d-881c-40f3-a51b-bd28dd0f9fa5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:11.226538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fca3d-ae4d-4cc8-90b3-998377ee7f8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:11.227795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fca3d-ae4d-4cc8-90b3-998377ee7f8a service glance] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.228079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fca3d-ae4d-4cc8-90b3-998377ee7f8a service glance] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.228352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fca3d-ae4d-4cc8-90b3-998377ee7f8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.238842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fca3d-ae4d-4cc8-90b3-998377ee7f8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:11.240364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fca3d-ae4d-4cc8-90b3-998377ee7f8a service glance] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:11.251455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1106/2217] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:11.336369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e02a-4334-4abd-8936-656f423cf89d None None] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.336703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e02a-4334-4abd-8936-656f423cf89d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.336967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e02a-4334-4abd-8936-656f423cf89d None None] PATH_INFO: `/` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.338337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1112/2218] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:11.343954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0529d-662a-4c36-81f3-09af4daf38f2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.344373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0529d-662a-4c36-81f3-09af4daf38f2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.344650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0529d-662a-4c36-81f3-09af4daf38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.365281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-33b0529d-662a-4c36-81f3-09af4daf38f2 None None] MFA Rules not processed for user `e8980803eace443d849c22a6e0781894`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:11.366505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-33b0529d-662a-4c36-81f3-09af4daf38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:11.426665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1107/2219] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:03:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:11.439785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e02a-4334-4abd-8936-656f423cf89d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:11.441516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e8d7e02a-4334-4abd-8936-656f423cf89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:11.465473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e02a-4334-4abd-8936-656f423cf89d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:11.469289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035b445-c883-41cb-a8f6-1f4594a5c5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:11.469867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035b445-c883-41cb-a8f6-1f4594a5c5df service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.470428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035b445-c883-41cb-a8f6-1f4594a5c5df service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.470760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035b445-c883-41cb-a8f6-1f4594a5c5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.478698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035b445-c883-41cb-a8f6-1f4594a5c5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:11.480231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035b445-c883-41cb-a8f6-1f4594a5c5df service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:11.488288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1113/2220] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:11.576080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384406-8d71-49ff-b661-2f111eae5bfe None None] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.576373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384406-8d71-49ff-b661-2f111eae5bfe None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.576650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384406-8d71-49ff-b661-2f111eae5bfe None None] PATH_INFO: `/` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.578130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1108/2221] 10.222.0.65 () {54 vars in 921 bytes} [Wed Aug 24 10:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:03:11.583892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ffd9f-0b92-4c5d-97fd-226005f05220 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.584187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ffd9f-0b92-4c5d-97fd-226005f05220 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.584469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ffd9f-0b92-4c5d-97fd-226005f05220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.604715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1a8ffd9f-0b92-4c5d-97fd-226005f05220 None None] MFA Rules not processed for user `28f32f08ac32498ba75eb4faa022f464`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:11.605935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1a8ffd9f-0b92-4c5d-97fd-226005f05220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:11.615327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1114/2222] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Aug 24 10:03:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:11.626186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384406-8d71-49ff-b661-2f111eae5bfe None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:11.637557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384406-8d71-49ff-b661-2f111eae5bfe None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:11.641198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:11.641802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.642086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.642362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.654302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:11.655790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:11.670588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1109/2223] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:17.334206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4193761-8f2b-49cc-b54e-cf26116a06c3 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:17.334713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4193761-8f2b-49cc-b54e-cf26116a06c3 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:17.334803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4193761-8f2b-49cc-b54e-cf26116a06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:17.359181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e4193761-8f2b-49cc-b54e-cf26116a06c3 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:17.361145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e4193761-8f2b-49cc-b54e-cf26116a06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:17.394405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:17.424154 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1115/2224] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:17.437327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:17.439011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:17.512474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f296aa-5e86-4a1d-9312-8b071cac166f service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:17.520890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:17.521694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:17.522040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:17.522404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:17.532059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:17.533700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:17.542153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1110/2225] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:03:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:03:18.362703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052c457-76f4-4acf-81f5-9dd8f0e67d28 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:18.363232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052c457-76f4-4acf-81f5-9dd8f0e67d28 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:18.363430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052c457-76f4-4acf-81f5-9dd8f0e67d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:18.386730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c052c457-76f4-4acf-81f5-9dd8f0e67d28 None None] MFA Rules not processed for user `27e741952c6b42b2a5ecd9e2f2b70199`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:18.387899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c052c457-76f4-4acf-81f5-9dd8f0e67d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:18.447117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1116/2226] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:27.538821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:28.439239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=35 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:30.326416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:30.328483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:30.416152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca12a-c19d-4ba3-a389-3aa7b0f30b07 service swift] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:30.420995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:30.421632 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:30.421887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:30.422185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:30.424166 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:30.436972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:30.438594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:30.449229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1111/2227] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:37.995610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab460-e772-4186-86e2-244dbb4568af None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:37.996116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab460-e772-4186-86e2-244dbb4568af None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:37.996116 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab460-e772-4186-86e2-244dbb4568af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:38.016475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f7bab460-e772-4186-86e2-244dbb4568af None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:38.017685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f7bab460-e772-4186-86e2-244dbb4568af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:38.025799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1117/2228] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:38.038844 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:38.051037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6a58-1da0-45a0-85ab-900e796ee71b service placement] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:38.056803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:38.057403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:38.057665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:38.057929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:38.066531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:38.068514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:38.076851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1112/2229] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:03:48.010997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:48.073714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=38 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:49.428107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee0cc6-a00b-4be0-8779-5d4fd0e41693 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:49.428620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee0cc6-a00b-4be0-8779-5d4fd0e41693 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:49.428620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee0cc6-a00b-4be0-8779-5d4fd0e41693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:49.453477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2eee0cc6-a00b-4be0-8779-5d4fd0e41693 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:49.454158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2eee0cc6-a00b-4be0-8779-5d4fd0e41693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:49.463021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1118/2230] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:49.476692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:49.492110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3397375-9158-46f9-83e4-14b69f7e823f service swift] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:49.498239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447cdd-7b43-4ec0-9210-0b4c8a5a2a8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:49.498986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447cdd-7b43-4ec0-9210-0b4c8a5a2a8e service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:49.499298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447cdd-7b43-4ec0-9210-0b4c8a5a2a8e service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:49.499639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447cdd-7b43-4ec0-9210-0b4c8a5a2a8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:49.510732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a447cdd-7b43-4ec0-9210-0b4c8a5a2a8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:49.512582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a447cdd-7b43-4ec0-9210-0b4c8a5a2a8e service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:49.523620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1113/2231] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:03:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:03:59.445818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:59.517761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:05.735947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:05.736864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:05.737304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:05.760165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] MFA Rules not processed for user `9579f6a06b1743039bb5c3db8e88e460`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:05.761388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:05.830843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1119/2232] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:07.018059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:07.018612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:07.018741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:07.044757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:07.045975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:07.059209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1114/2233] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:07.067640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:07.079857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12893a-5538-4623-884e-dc6773684ebf None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:07.084832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:07.085518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:07.085862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:07.086190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:07.095162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:07.097277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:07.106775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1120/2234] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:04:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:04:09.368576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:09.371186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:09.463676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607eb1a-4556-4a1f-a367-de0f1b6dbceb None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:09.480898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:09.481559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:09.481843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:09.482124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] PATH_INFO: `/v3/users/27e741952c6b42b2a5ecd9e2f2b70199` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:09.483328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e741952c6b42b2a5ecd9e2f2b70199)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:09.485315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:09.538130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e741952c6b42b2a5ecd9e2f2b70199'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.538838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e741952c6b42b2a5ecd9e2f2b70199'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.539485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e741952c6b42b2a5ecd9e2f2b70199'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.548918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e741952c6b42b2a5ecd9e2f2b70199'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.556560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-90ec497b-ebbb-4f83-9035-4e3eab0526fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e741952c6b42b2a5ecd9e2f2b70199'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.574827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1115/2235] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:04:09 2022] DELETE /identity/v3/users/27e741952c6b42b2a5ecd9e2f2b70199 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:09.787453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:09.803430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57a0c0-25d0-46ff-9a3e-1ceb74b287af service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:09.878587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:09.879260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:09.880059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:09.880340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] PATH_INFO: `/v3/projects/acdc143a41a6433b9cd249a884c86ed4` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:09.881668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdc143a41a6433b9cd249a884c86ed4)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:09.883696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:09.936630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdc143a41a6433b9cd249a884c86ed4', 'request_id': 'req-8caa6f1e-161d-40c9-8b96-a1be93d380f5'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.942294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdc143a41a6433b9cd249a884c86ed4', 'request_id': 'req-8caa6f1e-161d-40c9-8b96-a1be93d380f5'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.948848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdc143a41a6433b9cd249a884c86ed4', 'request_id': 'req-8caa6f1e-161d-40c9-8b96-a1be93d380f5'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.963012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] The token cache is being invalidate because project acdc143a41a6433b9cd249a884c86ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:04:09.963235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.963860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8caa6f1e-161d-40c9-8b96-a1be93d380f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:09.965360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1121/2236] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:04:09 2022] DELETE /identity/v3/projects/acdc143a41a6433b9cd249a884c86ed4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:09.971624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:09.971941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:09.972250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:09.995599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:09.996869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:10.062459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1116/2237] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:04:10.070913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.071234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.071528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.091582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:10.092838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:10.101118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1122/2238] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:10.105341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.115956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b5a46-b4ab-4a2c-81e4-e795e7e2a020 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.120738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.121360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.121671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.121938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.122600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:04:10.122899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.124591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.134838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:10.139285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1117/2239] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:04:10.143636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.159292 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83ed0f-f31e-4ddb-841b-6092d32ba054 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.164516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.165143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.165428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.165708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.166351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.168342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.184636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:10.207299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1123/2240] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:04:10 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:10.211741 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.225988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3e96d-ef6c-4d39-9b52-66f412b6f062 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.298710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.299350 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.299625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.299892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.300549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.302812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.329998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1118/2241] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:04:10 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:10.334531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.345165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef7962-9b26-4675-bfa8-bc9a02e44297 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.350821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.351496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.351774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.352047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.352694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.354341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.365968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1124/2242] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:04:10.370048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.380627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72654e-f80f-4859-b865-08ed819cf000 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.385305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2b91-8655-4894-88f1-1af67c199d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.385904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2b91-8655-4894-88f1-1af67c199d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.386185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2b91-8655-4894-88f1-1af67c199d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.386455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2b91-8655-4894-88f1-1af67c199d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.387126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2b91-8655-4894-88f1-1af67c199d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.388737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2b91-8655-4894-88f1-1af67c199d98 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.399623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1119/2243] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:10.403892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.416420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edadf0-3860-4d31-9edc-35e81b41f817 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.421286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.421936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.422215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.422516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] PATH_INFO: `/v3/projects/e7c81d6fe4194bb2b977543c86c23ca1/users/79f48ade69f44b7cb5f7e8e83e8a10ed/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.437786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c81d6fe4194bb2b977543c86c23ca1, user_id=79f48ade69f44b7cb5f7e8e83e8a10ed, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.441033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.462746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1125/2244] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:10 2022] PUT /identity/v3/projects/e7c81d6fe4194bb2b977543c86c23ca1/users/79f48ade69f44b7cb5f7e8e83e8a10ed/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:10.535634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.535929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.536337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.564885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] MFA Rules not processed for user `79f48ade69f44b7cb5f7e8e83e8a10ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:10.566109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:10.633494 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1120/2245] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:10.645962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.648006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:10.716237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38bd41-dcc7-4f50-9886-6ff17a1d673e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.721401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c632dc-e773-4216-9cda-c3b951de3074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.722019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c632dc-e773-4216-9cda-c3b951de3074 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.722300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c632dc-e773-4216-9cda-c3b951de3074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.722564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c632dc-e773-4216-9cda-c3b951de3074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.733273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c632dc-e773-4216-9cda-c3b951de3074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.734784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c632dc-e773-4216-9cda-c3b951de3074 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.744958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1126/2246] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:10.770644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:10.837674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7be1-1ef6-4d87-8727-701b4a3e44d5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:10.843768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:10.844523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.844805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.845120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] PATH_INFO: `/v3/users/79f48ade69f44b7cb5f7e8e83e8a10ed` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.846399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f48ade69f44b7cb5f7e8e83e8a10ed)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:10.848449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:10.860163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:10.898321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f48ade69f44b7cb5f7e8e83e8a10ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:10.898972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f48ade69f44b7cb5f7e8e83e8a10ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:10.899606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f48ade69f44b7cb5f7e8e83e8a10ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:10.907790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f48ade69f44b7cb5f7e8e83e8a10ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:10.915893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f48ade69f44b7cb5f7e8e83e8a10ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:10.936582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1121/2247] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:04:10 2022] DELETE /identity/v3/users/79f48ade69f44b7cb5f7e8e83e8a10ed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:10.942922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:10.943457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:10.943590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:10.964222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:10.965415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:11.032347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1127/2248] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:11.042813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.044667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:11.125639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b08108-49ba-4dc0-a178-356c34153d21 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.129682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84513f86-e658-4bc0-a810-e94d246853ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.130299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84513f86-e658-4bc0-a810-e94d246853ad service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.130820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84513f86-e658-4bc0-a810-e94d246853ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.130820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84513f86-e658-4bc0-a810-e94d246853ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.140930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84513f86-e658-4bc0-a810-e94d246853ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.142425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84513f86-e658-4bc0-a810-e94d246853ad service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:11.153354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1122/2249] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:11.455403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.456881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:11.485054 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2142a2c-c3e4-49c7-a1d1-0af4e15aa3bc None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.491328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.491713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.492072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.492413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] PATH_INFO: `/v3/projects/e7c81d6fe4194bb2b977543c86c23ca1` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.493670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c81d6fe4194bb2b977543c86c23ca1)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.495936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:11.555271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c81d6fe4194bb2b977543c86c23ca1', 'request_id': 'req-022abb85-ab68-42de-a0ee-d2aa06524a92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:11.560317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:11.561507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c81d6fe4194bb2b977543c86c23ca1', 'request_id': 'req-022abb85-ab68-42de-a0ee-d2aa06524a92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:11.569798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c81d6fe4194bb2b977543c86c23ca1', 'request_id': 'req-022abb85-ab68-42de-a0ee-d2aa06524a92'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:11.583799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] The token cache is being invalidate because project e7c81d6fe4194bb2b977543c86c23ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:04:11.584088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:11.584752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-022abb85-ab68-42de-a0ee-d2aa06524a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:04:11.586278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1128/2250] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:04:11 2022] DELETE /identity/v3/projects/e7c81d6fe4194bb2b977543c86c23ca1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:04:11.591131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.591602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.591705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.611900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:11.613108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:11.676541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1123/2251] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:11.684122 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.684426 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.684673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.706079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:11.707329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:11.716218 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1129/2252] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:11.720337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.731248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b514-5637-47fb-a89e-e868bea6a076 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.737969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.738626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.738906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.739212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.739878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:04:11.740206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.741824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:11.758529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1124/2253] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:04:11.759753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.769185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faf453-d19a-4313-88e1-6ab3b6762fec None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.773973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.774584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.774867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.775203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.775875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.778053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:11.807474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1130/2254] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:04:11 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:04:11.811813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.823409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9e1c-3478-4e22-addd-b14e5e2fa267 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.837090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:11.889461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.890105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.890382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.890652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.891295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.893278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:11.929324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1125/2255] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:04:11 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:04:11.933685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.945000 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01fa1-e2f1-404e-a8f3-7ab4ee6769df admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.950068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.951176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.951521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.951878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.952543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.954176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:11.965259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1131/2256] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:11.969713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:11.980201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7274-27bf-4bb3-8ea4-0093557f940d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:11.985003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f78e7-af10-427c-b790-0d02513696c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:11.985624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f78e7-af10-427c-b790-0d02513696c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:11.985908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f78e7-af10-427c-b790-0d02513696c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:11.986183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f78e7-af10-427c-b790-0d02513696c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:11.986831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f78e7-af10-427c-b790-0d02513696c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:11.988482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f78e7-af10-427c-b790-0d02513696c2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:12.006406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1126/2257] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:04:12.007718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:12.018148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8431f-5dba-4672-9665-0682fb55ca96 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:12.023266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:12.023911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:12.024206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:12.024470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] PATH_INFO: `/v3/projects/052944b164fd43879f0d99d572c88850/users/4d68264b56114ec8b0ed1d8b7e6223a1/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:12.039852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] RBAC: Authorizing `identity:create_grant(project_id=052944b164fd43879f0d99d572c88850, user_id=4d68264b56114ec8b0ed1d8b7e6223a1, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:12.042515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:12.056994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1132/2258] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:04:12 2022] PUT /identity/v3/projects/052944b164fd43879f0d99d572c88850/users/4d68264b56114ec8b0ed1d8b7e6223a1/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:04:12.062501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e28c-bec3-4411-88a3-b269e8ad3037 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:12.062730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e28c-bec3-4411-88a3-b269e8ad3037 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:12.063010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e28c-bec3-4411-88a3-b269e8ad3037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:12.086443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-dd45e28c-bec3-4411-88a3-b269e8ad3037 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:12.087686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dd45e28c-bec3-4411-88a3-b269e8ad3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:12.150040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1127/2259] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:12.160142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:12.162244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:12.225698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f614f8-9ad3-4936-91d7-2a80452a156a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:12.230193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:12.230809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:12.231187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:12.231468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:12.242250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:12.243805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:12.253884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1133/2260] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:13.041869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581e03-5d65-4f55-9f75-14b2e30c258e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:13.041869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581e03-5d65-4f55-9f75-14b2e30c258e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:13.041869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581e03-5d65-4f55-9f75-14b2e30c258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:13.069401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bf581e03-5d65-4f55-9f75-14b2e30c258e None None] MFA Rules not processed for user `4d68264b56114ec8b0ed1d8b7e6223a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:13.070654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bf581e03-5d65-4f55-9f75-14b2e30c258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:13.170526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1128/2261] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:13.182814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:13.184333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:13.254303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea9c2-11e5-4f86-a900-2db80e00a054 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:13.258449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f76ec-9cdf-42c1-a070-87a27a811ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:13.259082 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f76ec-9cdf-42c1-a070-87a27a811ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:13.259382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f76ec-9cdf-42c1-a070-87a27a811ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:13.259642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f76ec-9cdf-42c1-a070-87a27a811ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:13.269080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f76ec-9cdf-42c1-a070-87a27a811ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:13.270690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f76ec-9cdf-42c1-a070-87a27a811ef4 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:13.280913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1134/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:14.700315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0584b-2071-4983-b571-73bd06d3bf1f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:14.701188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0584b-2071-4983-b571-73bd06d3bf1f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:14.701188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0584b-2071-4983-b571-73bd06d3bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:14.728330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-23e0584b-2071-4983-b571-73bd06d3bf1f None None] MFA Rules not processed for user `4d68264b56114ec8b0ed1d8b7e6223a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:14.729607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-23e0584b-2071-4983-b571-73bd06d3bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:14.738246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1129/2263] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:17.927674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac16c-304d-4bef-80f8-0de443ce9431 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:17.928211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac16c-304d-4bef-80f8-0de443ce9431 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:17.928211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ac16c-304d-4bef-80f8-0de443ce9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:17.950963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6e9ac16c-304d-4bef-80f8-0de443ce9431 None None] MFA Rules not processed for user `cf76e4d108e140508be72bd1afd5ca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:17.952330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e9ac16c-304d-4bef-80f8-0de443ce9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:17.977766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:18.017985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1135/2264] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:04:24.721539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:28.010777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=13 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:38.332762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:38.333626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:38.333818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:38.353848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] MFA Rules not processed for user `7b478a587aa7484898b16e6fd5564253`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:38.355064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:38.416668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1130/2265] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:48.412123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=25 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:53.124519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed110ed-630b-4c0d-a427-e214d799bf79 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:53.125138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed110ed-630b-4c0d-a427-e214d799bf79 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:53.125138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed110ed-630b-4c0d-a427-e214d799bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:53.150301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2ed110ed-630b-4c0d-a427-e214d799bf79 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:53.151830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2ed110ed-630b-4c0d-a427-e214d799bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:53.162557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1136/2266] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:53.193547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:53.195500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:53.275673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb3ece-d55e-4cf2-8819-35c4d197d93c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:53.281429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:53.282048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:53.282410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:53.282685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:53.294357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:53.296232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:53.306882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1131/2267] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:59.262127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380101-283a-4128-b557-efa1bb184253 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:59.262678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380101-283a-4128-b557-efa1bb184253 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:59.262678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e380101-283a-4128-b557-efa1bb184253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:59.294463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2e380101-283a-4128-b557-efa1bb184253 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:04:59.295750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2e380101-283a-4128-b557-efa1bb184253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:59.305605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1137/2268] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:04:59.331721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:59.333295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:59.350570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8b249-2311-42c2-a297-31322ce8dd21 service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:59.363252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce113e-083b-4a25-9005-2f36172c0603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:59.363895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce113e-083b-4a25-9005-2f36172c0603 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:59.364162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce113e-083b-4a25-9005-2f36172c0603 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:59.364434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce113e-083b-4a25-9005-2f36172c0603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:59.374709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce113e-083b-4a25-9005-2f36172c0603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:59.376734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce113e-083b-4a25-9005-2f36172c0603 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:59.387420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1132/2269] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:02.376913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:02.377477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:02.377477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:02.396676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] MFA Rules not processed for user `8576deb9a96d458cba3e374b36a233b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:02.397903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:02.464011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1138/2270] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:02.542637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7491d-d7ab-4da3-a806-8b4e32172ba2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:02.543493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7491d-d7ab-4da3-a806-8b4e32172ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:02.544061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7491d-d7ab-4da3-a806-8b4e32172ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:02.565620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2cf7491d-d7ab-4da3-a806-8b4e32172ba2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:02.566750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2cf7491d-d7ab-4da3-a806-8b4e32172ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:02.575951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1133/2271] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:02.610419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:02.624164 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fffcd-c7ec-48ed-891a-9250cd08f199 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:02.631243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:02.631870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:02.632205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:02.632666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:02.645061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:02.646658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:02.656274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1139/2272] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:05.617904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3a82d-abba-4c55-9ba9-fa19045dd546 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:05.618463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3a82d-abba-4c55-9ba9-fa19045dd546 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:05.618463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3a82d-abba-4c55-9ba9-fa19045dd546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:05.639311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e1c3a82d-abba-4c55-9ba9-fa19045dd546 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:05.640916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e1c3a82d-abba-4c55-9ba9-fa19045dd546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:05.650534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1134/2273] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:05.676466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:05.695185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eaf95-34e0-4cec-878d-b5c3a256aed4 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:05.702821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:05.703453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:05.703947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:05.704326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:05.714394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:05.716040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:05.728210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1140/2274] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:09.800729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:09.801312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:09.801312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:09.824430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:09.825631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:09.835075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1135/2275] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:09.874651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:09.887583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbd14-2acd-4eb7-8c21-82dd67372dcc service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:09.895125 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83dd99-90e3-4402-98ea-ffd37c2f817d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:09.895747 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83dd99-90e3-4402-98ea-ffd37c2f817d service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:09.896028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83dd99-90e3-4402-98ea-ffd37c2f817d service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:09.896306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83dd99-90e3-4402-98ea-ffd37c2f817d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:09.908349 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83dd99-90e3-4402-98ea-ffd37c2f817d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:09.909948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83dd99-90e3-4402-98ea-ffd37c2f817d service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:09.920283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1141/2276] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:14.945799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:14.956376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a1653-0e38-470e-bd16-90a717440131 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:14.960197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:14.960799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:14.961092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:14.961671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:14.963241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:14.982069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:14.982311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:14.994407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1136/2277] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:15.064007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987182ed-10d6-4f39-af00-104090cead1b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:15.064615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987182ed-10d6-4f39-af00-104090cead1b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:15.064745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987182ed-10d6-4f39-af00-104090cead1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:15.092725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-987182ed-10d6-4f39-af00-104090cead1b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:15.095884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-987182ed-10d6-4f39-af00-104090cead1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:15.107889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1142/2278] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:15.149259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:15.161478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa4a0c-45bf-4886-afce-52d3a3fc838b service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:15.167176 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:15.167892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:15.168154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:15.168543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:15.177230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:15.178812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:15.188939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1137/2279] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:16.488858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987182ed-10d6-4f39-af00-104090cead1b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:16.491211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-987182ed-10d6-4f39-af00-104090cead1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:16.507501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987182ed-10d6-4f39-af00-104090cead1b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:16.511793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:16.512401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:16.512681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:16.512950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:16.514872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:16.531142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:16.532589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:16.544644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1143/2280] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:19.866053 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:19.871095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=62 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:19.878041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448503-39b8-4d00-9b7f-48da116b7b33 service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:19.881655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:19.882260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:19.882583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:19.882856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:19.884917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:19.896400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:19.897829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:19.907154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1138/2281] 10.222.0.65 () {60 vars in 1396 bytes} [Wed Aug 24 10:05:19 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:26.539133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=58 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:29.902911 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:31.977015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:31.989493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b64962-326b-41c2-96ef-c139636dc01b service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:31.996565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:31.997181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:31.997462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:31.997729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:31.999967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:32.012950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:32.014587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da483412-e754-4228-9b2a-b75b656f291e service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:32.026597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1144/2282] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:40.826424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:40.840761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30d588-3615-4554-8473-a226eed1a452 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:40.848102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:40.848720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:40.848978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:40.849247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:40.851059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:40.913355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:40.914970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:40.924504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1139/2283] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:42.019678 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=6 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:43.699240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:43.700144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:43.700250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:43.723446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] MFA Rules not processed for user `4d68264b56114ec8b0ed1d8b7e6223a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:43.724684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:43.732757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1145/2284] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:43.997056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:44.007035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6dbf-17a7-4d7c-8596-be5f3dda8948 service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:44.012054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:44.012703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:44.012956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:44.013210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:44.015187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:44.026382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:44.027893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed03975-2592-4f4e-85af-d21ce7e8f480 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:44.037752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1140/2285] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:44.399310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:44.400496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:44.500445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c981b1-8579-44aa-a062-9ea57c7dbcdb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:44.519383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:44.522001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:44.522341 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:44.522603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:44.525943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:44.541761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:44.543482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:44.556466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1146/2286] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:46.526709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:46.527279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:46.527279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:46.547219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] MFA Rules not processed for user `9579f6a06b1743039bb5c3db8e88e460`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:46.548439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:46.555878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1141/2287] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:46.826475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:46.838484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cc9ee-3d29-4754-8031-bb69cef9c6ca service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:46.843381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:46.844011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:46.844287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:46.844551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:46.846906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:46.859941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:46.861903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:46.873506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1147/2288] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:47.200060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:47.215526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403823f8-a406-41c3-b5ba-2404567a2d2e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:47.221094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:47.223120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:47.223563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:47.223913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:47.225992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:47.239178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:47.242345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:47.252144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1142/2289] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:53.167821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:53.174710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:53.193870 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2675d71-0288-4f6e-a474-932f4eda599d service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:53.200901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:53.201551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.201830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.202099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.204086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:53.225469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:53.232417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:53.233487 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:53.234955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:53.243979 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1148/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:53.262164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491b39-f5db-47ed-920c-0dddb74e375e service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:53.267364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:53.268078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.268365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.268640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] PATH_INFO: `/v3/users/cf76e4d108e140508be72bd1afd5ca2f` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.269993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf76e4d108e140508be72bd1afd5ca2f)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:53.271968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:53.326268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf76e4d108e140508be72bd1afd5ca2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.326989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf76e4d108e140508be72bd1afd5ca2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.327689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf76e4d108e140508be72bd1afd5ca2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.336414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf76e4d108e140508be72bd1afd5ca2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.344152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-0c175651-3fb6-49c1-a4af-38b027022c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf76e4d108e140508be72bd1afd5ca2f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.362518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1143/2291] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:05:53 2022] DELETE /identity/v3/users/cf76e4d108e140508be72bd1afd5ca2f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:05:53.553892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:53.569437 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f7cd0-7208-46ec-b76c-667cce4f2a67 service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:53.639729 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:53.640396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.640680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.641149 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] PATH_INFO: `/v3/projects/81bb6322cc754ccd8e70a0f185e7fd30` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.642340 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bb6322cc754ccd8e70a0f185e7fd30)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:53.644714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:53.700035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bb6322cc754ccd8e70a0f185e7fd30', 'request_id': 'req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.706368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bb6322cc754ccd8e70a0f185e7fd30', 'request_id': 'req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.707695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:53.714308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bb6322cc754ccd8e70a0f185e7fd30', 'request_id': 'req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.730859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] The token cache is being invalidate because project 81bb6322cc754ccd8e70a0f185e7fd30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:05:53.731189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.731831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4243c0e8-b64b-4531-a5c2-fc567c3f0bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:05:53.733383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1149/2292] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:05:53 2022] DELETE /identity/v3/projects/81bb6322cc754ccd8e70a0f185e7fd30 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:05:53.739439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.739733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.740010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.760926 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:53.762248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:53.808989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:53.845508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1144/2293] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:53.854207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.854492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.854765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.876245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:53.877424 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:53.886544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1150/2294] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:53.891079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:53.901404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e605243-a52c-45f9-83fc-94023d8674c9 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:53.906606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:53.907285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.907596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.907872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.908716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:05:53.909345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:53.911096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:53.913416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:53.915510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:53.925485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1145/2295] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:05:53.929748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:53.940180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d9fd-0737-42f1-92ed-073eb7f8f0ce admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:53.947813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:53.948451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:53.948717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:53.948989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:53.949623 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:53.952468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:53.992404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1146/2296] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:05:53 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:05:53.996692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.013422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0b968-90fc-4383-8efc-ba5e9973a760 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.075988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3293-1d4e-4bc7-a501-0e1bfcb877cb admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.081950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.083325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.083899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.084485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.085989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.088753 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.097854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.098603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.098888 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.099275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.101484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:54.114051 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1147/2297] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:05:53 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:05:54.119082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.131286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52775cf6-4489-40b5-b883-244323019974 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.137403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.138036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.138316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.138585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.139264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.140953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.156019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1148/2298] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:05:54.160126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.171726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e542a-2ef3-4642-b65d-855399da26b1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.176592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.177228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.177496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.177770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.178412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.180728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.191103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.192769 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c220aa-79cc-4265-8f8a-54aec06c055a service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.193364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1149/2299] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:05:54.198221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.208085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1151/2300] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:05:54.208735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67047-0eb4-4fc9-9390-d3a6499511fa admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.213755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.214643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.214933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.215331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] PATH_INFO: `/v3/projects/617dffcbae9c4ae08f9cd334df5b05bf/users/c6374cb67c4a49c9babc55acf408a1d8/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.234904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=617dffcbae9c4ae08f9cd334df5b05bf, user_id=c6374cb67c4a49c9babc55acf408a1d8, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.238932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.258572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1150/2301] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:05:54 2022] PUT /identity/v3/projects/617dffcbae9c4ae08f9cd334df5b05bf/users/c6374cb67c4a49c9babc55acf408a1d8/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:05:54.270774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.271370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.271530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.309530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] MFA Rules not processed for user `c6374cb67c4a49c9babc55acf408a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:54.311181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:54.316280 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:54.406356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1152/2302] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:54.411289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.471722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:54.494197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec3350-91ff-4dcb-9158-92570ca28a00 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.512426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.513247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.514015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.514550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.515566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.518312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.559430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1151/2303] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:05:54 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:05:54.560785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.575279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141f032-b65e-425c-aec2-b06b6afd7501 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.637306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.637857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.638144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.638419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.639081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.641077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.667552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1153/2304] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:05:54 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:05:54.670876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.694762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0bb4-e7f0-4aca-9c91-190ea91dcf9b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.703254 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.704307 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.704808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.705456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.706351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.709231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.722545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1152/2305] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:05:54.726513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.737175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323068-b9dc-4bda-9442-6c3a0a3c6a44 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.742601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.743409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.743753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.744087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] PATH_INFO: `/v3/projects/24433743ce464f1ea1f8243100ea3d9a/users/2efeabd69296471e82c49fb87949c19d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.760591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24433743ce464f1ea1f8243100ea3d9a, user_id=2efeabd69296471e82c49fb87949c19d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.763616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.778342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1154/2306] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:05:54 2022] PUT /identity/v3/projects/24433743ce464f1ea1f8243100ea3d9a/users/2efeabd69296471e82c49fb87949c19d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:05:54.782456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.793453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0fa8b-4927-4287-aeef-8448a75b106d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.851392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c17aa-873b-4142-a1cc-dcf195a99577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.852008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c17aa-873b-4142-a1cc-dcf195a99577 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.852289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c17aa-873b-4142-a1cc-dcf195a99577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.852546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c17aa-873b-4142-a1cc-dcf195a99577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.853191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c17aa-873b-4142-a1cc-dcf195a99577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.854811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c17aa-873b-4142-a1cc-dcf195a99577 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.864464 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1153/2307] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:05:54.868901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:54.880450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c57b-4358-4300-88ba-4575c281e73a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:54.886577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:54.887288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.887631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.887837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] PATH_INFO: `/v3/projects/24433743ce464f1ea1f8243100ea3d9a/users/2efeabd69296471e82c49fb87949c19d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.889774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24433743ce464f1ea1f8243100ea3d9a, user_id=2efeabd69296471e82c49fb87949c19d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:54.892568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:54.903840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1155/2308] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:05:54 2022] PUT /identity/v3/projects/24433743ce464f1ea1f8243100ea3d9a/users/2efeabd69296471e82c49fb87949c19d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:05:54.917217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:54.917502 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:54.917776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:54.951088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] MFA Rules not processed for user `2efeabd69296471e82c49fb87949c19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:05:54.952347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:55.026714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1154/2309] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:05:55.038986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:55.040760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:05:55.105007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef377a-aad7-456f-89e0-6c36aa80d347 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:55.108793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0257f06-8033-43bf-a7f8-d3ceba62e361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:55.109405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0257f06-8033-43bf-a7f8-d3ceba62e361 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:55.109679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0257f06-8033-43bf-a7f8-d3ceba62e361 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:55.109947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0257f06-8033-43bf-a7f8-d3ceba62e361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:55.119434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0257f06-8033-43bf-a7f8-d3ceba62e361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:55.120872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0257f06-8033-43bf-a7f8-d3ceba62e361 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:55.125753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:55.131761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1156/2310] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:05:55.216867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:05:55.227312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23d79b-5563-4a40-8950-70778c5f993d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:05:55.230907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:05:55.231553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:05:55.231833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:05:55.232099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:05:55.272202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:55.291159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:05:55.293219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:05:55.308239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1155/2311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:00.472395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:00.473166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:00.473166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:00.494529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:00.495810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:00.561824 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1157/2312] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:00.605078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:00.606579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:00.699184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325a82-4359-480d-9ff8-e0f7947eac32 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:00.704500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:00.705114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:00.705389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:00.705656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:00.714679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:00.716333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:00.726640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1156/2313] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:01.948226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:01.963234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dee5a9-313c-499b-a79b-2e137414c4e8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:01.969084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:01.969754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:01.970042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:01.970316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:01.972491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:01.985346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:01.987074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e68e-6257-45c5-9508-506635dd5b9a service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:01.998632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1158/2314] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:02.556319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:02.586010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b080-0c12-4818-8539-e89a2c67ddb0 service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:02.598291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:02.598969 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:02.599277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:02.599556 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] PATH_INFO: `/v3/users/c6374cb67c4a49c9babc55acf408a1d8` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:02.600818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6374cb67c4a49c9babc55acf408a1d8)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:02.604298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:02.692113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6374cb67c4a49c9babc55acf408a1d8'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:02.692814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6374cb67c4a49c9babc55acf408a1d8'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:02.693460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6374cb67c4a49c9babc55acf408a1d8'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:02.706250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6374cb67c4a49c9babc55acf408a1d8'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:02.723812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6374cb67c4a49c9babc55acf408a1d8'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:02.737999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1157/2315] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:02 2022] DELETE /identity/v3/users/c6374cb67c4a49c9babc55acf408a1d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:02.742337 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:02.742625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:02.743676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:02.767183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:02.768370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:02.832862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1159/2316] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:02.843112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:02.844558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:02.890578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:02.909980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc08a1-6167-4f25-b89e-d12d7e150c37 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:02.917724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:02.918479 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:02.918725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:02.919001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:02.933560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:02.941119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:02.953154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1158/2317] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:03.317516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:03.319286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:03.335193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995e27-635e-4da9-92ec-409ac17dfd40 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:03.341421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:03.341938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:03.342217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:03.342465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] PATH_INFO: `/v3/projects/617dffcbae9c4ae08f9cd334df5b05bf` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:03.343863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=617dffcbae9c4ae08f9cd334df5b05bf)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:03.345738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:03.401911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617dffcbae9c4ae08f9cd334df5b05bf', 'request_id': 'req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.408552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617dffcbae9c4ae08f9cd334df5b05bf', 'request_id': 'req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.415430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617dffcbae9c4ae08f9cd334df5b05bf', 'request_id': 'req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.430808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] The token cache is being invalidate because project 617dffcbae9c4ae08f9cd334df5b05bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:03.431138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.431917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f59fcc-f711-4f6b-bd1c-cb1fcd6430f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.434438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1160/2318] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:03 2022] DELETE /identity/v3/projects/617dffcbae9c4ae08f9cd334df5b05bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:03.438876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:03.449392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bac1fc-51b2-4bd6-a501-e08732106214 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:03.515309 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:03.516191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:03.516832 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:03.517409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] PATH_INFO: `/v3/users/2efeabd69296471e82c49fb87949c19d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:03.519199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efeabd69296471e82c49fb87949c19d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:03.521432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:03.576489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efeabd69296471e82c49fb87949c19d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.577252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efeabd69296471e82c49fb87949c19d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.577634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efeabd69296471e82c49fb87949c19d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.586428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efeabd69296471e82c49fb87949c19d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.593515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efeabd69296471e82c49fb87949c19d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:03.610618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1159/2319] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:03 2022] DELETE /identity/v3/users/2efeabd69296471e82c49fb87949c19d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:03.674046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:03.674330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:03.674602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:03.696932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:03.698222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:03.704291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:03.772943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1161/2320] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:03.796926 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:03.799237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:03.871997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:03.891482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f93eb-f029-42f1-b660-39c8a23c9ed3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:03.899325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a69f1-30fe-4cda-b776-72fa7176bce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:03.919474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a69f1-30fe-4cda-b776-72fa7176bce7 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:03.919474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a69f1-30fe-4cda-b776-72fa7176bce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:03.919474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a69f1-30fe-4cda-b776-72fa7176bce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:03.922261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a69f1-30fe-4cda-b776-72fa7176bce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:03.924184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a69f1-30fe-4cda-b776-72fa7176bce7 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:03.930100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:03.931775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:03.939498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1160/2321] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:03.948744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58de04-a897-427f-b7e1-fd8bda9d8708 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:03.953876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:03.954518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:03.954798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:03.955240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] PATH_INFO: `/v3/projects/24433743ce464f1ea1f8243100ea3d9a` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:03.957592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] RBAC: Authorizing `identity:delete_project(project_id=24433743ce464f1ea1f8243100ea3d9a)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:03.959385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.012907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24433743ce464f1ea1f8243100ea3d9a', 'request_id': 'req-44820c76-1a2a-4292-9edc-ba635a0a073a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:04.019542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24433743ce464f1ea1f8243100ea3d9a', 'request_id': 'req-44820c76-1a2a-4292-9edc-ba635a0a073a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:04.026050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24433743ce464f1ea1f8243100ea3d9a', 'request_id': 'req-44820c76-1a2a-4292-9edc-ba635a0a073a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:04.042372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] The token cache is being invalidate because project 24433743ce464f1ea1f8243100ea3d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:04.042662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:04.043366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-44820c76-1a2a-4292-9edc-ba635a0a073a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:04.044956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1162/2322] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:03 2022] DELETE /identity/v3/projects/24433743ce464f1ea1f8243100ea3d9a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:04.050222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.051189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.051189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.074364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:04.075639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:04.140099 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1161/2323] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:04.148348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.148697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.153513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.169211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:04.170430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:04.178871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1163/2324] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:04.183515 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.194663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e31df2-50ba-401d-bc0a-df06e490ec58 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.207006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.207944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.208257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.208533 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.209228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:04.209500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.211157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.225193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1162/2325] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:04.230495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.245008 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b51f-0c1c-419b-a318-275855cb4eeb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.253691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.254293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.254577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.254850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.255501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.257452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.292555 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1164/2326] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:04.294174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.304764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5340326-ad82-45c4-86b2-1951e7a95958 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.364250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.364870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.365150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.365421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.366049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.368056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.394959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1163/2327] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:04.399461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.410305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644bb2-6bd1-43da-9c06-dd6ff7a43f1c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.415264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.415868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.416145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.416409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.417049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.418716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.429052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1165/2328] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:04.433610 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.443830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759eb3-4325-4311-9ec5-65c9e87c7856 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.448802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9ee30-9f35-479c-96d2-48a65fbecb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.449403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9ee30-9f35-479c-96d2-48a65fbecb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.449680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9ee30-9f35-479c-96d2-48a65fbecb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.449945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9ee30-9f35-479c-96d2-48a65fbecb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.450583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9ee30-9f35-479c-96d2-48a65fbecb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.452227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9ee30-9f35-479c-96d2-48a65fbecb39 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.464389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1164/2329] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:04.468597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.478825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7ace8-5b6c-4413-8135-7fca4fad21a9 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.483902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.484546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.484822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.485067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] PATH_INFO: `/v3/projects/32b9ebd182794d18827ab4f34b3f523e/users/68cb735d02e544b9ac79ee944238b111/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.508124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b9ebd182794d18827ab4f34b3f523e, user_id=68cb735d02e544b9ac79ee944238b111, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.510925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.527671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1166/2330] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:04 2022] PUT /identity/v3/projects/32b9ebd182794d18827ab4f34b3f523e/users/68cb735d02e544b9ac79ee944238b111/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:04.546314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.546781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.547223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.578739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] MFA Rules not processed for user `68cb735d02e544b9ac79ee944238b111`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:04.579984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:04.620506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:04.647823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1165/2331] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:04.652514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.687173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:04.720160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e4cf-f4ce-4065-8258-4f4fa45d32e8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.725380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.726017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.726302 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.726576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.727250 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.729187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.759492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1167/2332] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:06:04.765062 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.776506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdfc40-56e9-4fd7-b5d2-4e87e0fc170a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.838607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.839235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.839524 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.839799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.840444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.842386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.869430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1166/2333] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:04 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:06:04.873906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.885085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5873a83-ce19-41e6-9b8e-8441837ccae0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.890615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.891251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.891528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.891794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.892439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.894102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.905052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1168/2334] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:06:04.909390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.922098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8977-32f1-4379-b037-e38355813650 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:04.928435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:04.929060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:04.929489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:04.929789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] PATH_INFO: `/v3/projects/4bd86003490246a39f65019077c34acc/users/8d9c216b16ce408e92dce46035108446/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:04.949401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd86003490246a39f65019077c34acc, user_id=8d9c216b16ce408e92dce46035108446, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:04.952278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:04.966893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1167/2335] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:04 2022] PUT /identity/v3/projects/4bd86003490246a39f65019077c34acc/users/8d9c216b16ce408e92dce46035108446/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:04.971138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:04.982291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6f41-105c-4338-9a85-8a90356480b4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.043727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd132c2e-5f01-40fc-b1df-4fa9c7d4f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.044351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132c2e-5f01-40fc-b1df-4fa9c7d4f643 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.044632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132c2e-5f01-40fc-b1df-4fa9c7d4f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.045686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132c2e-5f01-40fc-b1df-4fa9c7d4f643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.046698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd132c2e-5f01-40fc-b1df-4fa9c7d4f643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.048488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd132c2e-5f01-40fc-b1df-4fa9c7d4f643 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.066610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1169/2336] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:05.068288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:05.079509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c4d0b-b960-4b5e-b612-e59340cd7e9b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.085228 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.085943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.086284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.086563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] PATH_INFO: `/v3/projects/4bd86003490246a39f65019077c34acc/users/8d9c216b16ce408e92dce46035108446/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.088913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd86003490246a39f65019077c34acc, user_id=8d9c216b16ce408e92dce46035108446, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.092597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.108449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1168/2337] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:05 2022] PUT /identity/v3/projects/4bd86003490246a39f65019077c34acc/users/8d9c216b16ce408e92dce46035108446/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:05.119891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.119891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.119891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.149612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] MFA Rules not processed for user `8d9c216b16ce408e92dce46035108446`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:05.150871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:05.226897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1170/2338] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:05.242202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:05.244178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:05.308548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bec67-d169-44b6-9afd-c733a5a9ecc2 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.312959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.313579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.313869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.314138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.325198 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.326640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.336939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1169/2339] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:06:05.695313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:05.705150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1cad-1fca-4cf5-8722-46ab52ac7b7c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.710614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d9c216b16ce408e92dce46035108446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd86003490246a39f65019077c34acc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.711255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.711562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.711843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.712519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:05.712819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.714472 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.727717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1171/2340] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:05.733873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:05.744645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc717e-395a-44b3-8be0-d3643a5f97a5 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.750381 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d9c216b16ce408e92dce46035108446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd86003490246a39f65019077c34acc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.751185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.751469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.751746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.752374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.754497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.784246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1170/2341] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:05 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:06:05.788627 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:05.799431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb7ef4-86f5-4eda-beda-af03be509f7e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.812706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:05.863503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d9c216b16ce408e92dce46035108446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd86003490246a39f65019077c34acc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.864079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.864361 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.864637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.865297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:05.865602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.867241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.878881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1172/2342] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:05.923290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:05.934301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f32a3-a7bd-4540-b3ab-dc330f354672 tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:05.940164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d9c216b16ce408e92dce46035108446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bd86003490246a39f65019077c34acc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:05.941142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:05.941142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:05.941373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] PATH_INFO: `/v3/projects/175c3bc55548409ba06b3b5e8d17cb66` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:05.942656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorizing `identity:delete_project(project_id=175c3bc55548409ba06b3b5e8d17cb66)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:05.944659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:05.954030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:05.997973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175c3bc55548409ba06b3b5e8d17cb66', 'request_id': 'req-e6306ebd-04af-40ee-899a-5b5be2f9601e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.005612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175c3bc55548409ba06b3b5e8d17cb66', 'request_id': 'req-e6306ebd-04af-40ee-899a-5b5be2f9601e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.011922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175c3bc55548409ba06b3b5e8d17cb66', 'request_id': 'req-e6306ebd-04af-40ee-899a-5b5be2f9601e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.025735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] The token cache is being invalidate because project 175c3bc55548409ba06b3b5e8d17cb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:06.026029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.026699 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e6306ebd-04af-40ee-899a-5b5be2f9601e tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.028295 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1171/2343] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:05 2022] DELETE /identity/v3/projects/175c3bc55548409ba06b3b5e8d17cb66 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:06.237655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:06.239654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:06.314305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc63c5f-83f6-44d4-bd9b-4d0ccbc3f06f tempest-VolumeQuotaClassesTest-358104525 tempest-VolumeQuotaClassesTest-358104525-project-admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:06.376464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:06.377099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:06.377381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:06.377654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] PATH_INFO: `/v3/users/68cb735d02e544b9ac79ee944238b111` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:06.379744 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cb735d02e544b9ac79ee944238b111)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:06.381779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:06.437460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cb735d02e544b9ac79ee944238b111'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.438347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cb735d02e544b9ac79ee944238b111'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.448700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cb735d02e544b9ac79ee944238b111'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.449414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cb735d02e544b9ac79ee944238b111'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.453153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:06.462851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cb735d02e544b9ac79ee944238b111'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:06.480633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1173/2344] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:06 2022] DELETE /identity/v3/users/68cb735d02e544b9ac79ee944238b111 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:06.485290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33c71-7e78-45fb-bf28-f0123f2e810a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:06.485585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33c71-7e78-45fb-bf28-f0123f2e810a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:06.485910 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33c71-7e78-45fb-bf28-f0123f2e810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:06.507363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-20b33c71-7e78-45fb-bf28-f0123f2e810a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:06.508654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-20b33c71-7e78-45fb-bf28-f0123f2e810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:06.582007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1172/2345] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:06.591999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:06.593720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:06.658810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cda8d6-9733-4bb0-86b6-6f4186365c75 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:06.662938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:06.663783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:06.664130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:06.664469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:06.677126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:06.678585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:06.690152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1174/2346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:06.777863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:06.778400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:06.778483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:06.799717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:06.801206 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:06.812239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1173/2347] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:06.842161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:06.849320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:06.983896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557a6de-2475-4a84-b411-b91b7d754a33 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:06.991652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:06.992287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:06.992566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:06.992837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.016742 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:07.019557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:07.033995 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1175/2348] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:06:07.036179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:07.038400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:07.056809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9ea47-9f7b-41b6-ae8e-c22305534d4e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:07.063734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:07.064536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:07.065131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:07.065492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] PATH_INFO: `/v3/projects/32b9ebd182794d18827ab4f34b3f523e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.068766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b9ebd182794d18827ab4f34b3f523e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:07.074258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:07.129301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b9ebd182794d18827ab4f34b3f523e', 'request_id': 'req-2035845d-fb68-48d8-aec4-e2f99a8f06b3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.136407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b9ebd182794d18827ab4f34b3f523e', 'request_id': 'req-2035845d-fb68-48d8-aec4-e2f99a8f06b3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.142473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b9ebd182794d18827ab4f34b3f523e', 'request_id': 'req-2035845d-fb68-48d8-aec4-e2f99a8f06b3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.159653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] The token cache is being invalidate because project 32b9ebd182794d18827ab4f34b3f523e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:07.160036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.160716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.162261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1174/2349] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:07 2022] DELETE /identity/v3/projects/32b9ebd182794d18827ab4f34b3f523e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:07.167765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:07.178881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c268c0-6a9a-465e-beea-e292b24ab20c service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:07.251031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:07.251737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:07.252035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:07.252286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] PATH_INFO: `/v3/users/8d9c216b16ce408e92dce46035108446` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.253641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9c216b16ce408e92dce46035108446)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:07.255728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:07.258143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:07.309248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9c216b16ce408e92dce46035108446'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.309920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9c216b16ce408e92dce46035108446'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.319348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9c216b16ce408e92dce46035108446'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.319988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9c216b16ce408e92dce46035108446'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.327805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-40bef1cf-d499-41c8-8e4d-6650de1b3e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9c216b16ce408e92dce46035108446'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.348950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1176/2350] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:07 2022] DELETE /identity/v3/users/8d9c216b16ce408e92dce46035108446 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:07.639547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:07.641029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:07.654810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035845d-fb68-48d8-aec4-e2f99a8f06b3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:07.664428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:07.715280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:07.715921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:07.716195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:07.716458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] PATH_INFO: `/v3/projects/4bd86003490246a39f65019077c34acc` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.717562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd86003490246a39f65019077c34acc)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:07.719486 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:07.768986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd86003490246a39f65019077c34acc', 'request_id': 'req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.775516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd86003490246a39f65019077c34acc', 'request_id': 'req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.781546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd86003490246a39f65019077c34acc', 'request_id': 'req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.795029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] The token cache is being invalidate because project 4bd86003490246a39f65019077c34acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:07.795344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.795940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-afdcd4ad-dd7b-43ac-9332-494c97a6e04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:07.797441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1175/2351] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:07 2022] DELETE /identity/v3/projects/4bd86003490246a39f65019077c34acc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:07.803572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:07.803859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:07.804131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.825129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:07.826289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:07.902496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1177/2352] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:07.918162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:07.918421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:07.918935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.943723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:07.944937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:07.955376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1176/2353] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:07.960152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:07.970712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fff513-bf47-47ab-98fa-ab40bd383946 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:07.976436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:07.977046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:07.977331 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:07.977609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:07.978251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:07.978563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:07.980233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:07.992323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1178/2354] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:07.996963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.007481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b896492-f9dc-420a-a260-be0378ec7077 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.012693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.013302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.013581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.013853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.014482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.016444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.046482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1177/2355] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:08.051286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.061846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ebfa7-6025-4585-a917-bcbd6b3d159c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.133976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.134784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.135102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.135460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.136151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.138617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.158074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:08.168654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1179/2356] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:08 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:08.173274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.184878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dcfec-b98a-401e-a347-6a250a9e22dd admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.189787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.190405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.190687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.190966 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.191733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.193635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.204317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1178/2357] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:08.208593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.220025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9fa77-6fb3-4eb4-acb7-3f58d3264f93 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.225546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d09ee-a8b0-4b10-960f-9cfe569a31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.226178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d09ee-a8b0-4b10-960f-9cfe569a31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.226464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d09ee-a8b0-4b10-960f-9cfe569a31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.226737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d09ee-a8b0-4b10-960f-9cfe569a31a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.227434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d09ee-a8b0-4b10-960f-9cfe569a31a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.229158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d09ee-a8b0-4b10-960f-9cfe569a31a5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.241654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1180/2358] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:08.246305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.257854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c00b9-b4fa-4c57-b425-231b37809c13 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.262948 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.263639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.263921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.264194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] PATH_INFO: `/v3/projects/9c71fa31e23e4a5ea77477f81b4c5969/users/c62cea49b988422880702ee1bb045975/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.284727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c71fa31e23e4a5ea77477f81b4c5969, user_id=c62cea49b988422880702ee1bb045975, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.289345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.305990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1179/2359] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:08 2022] PUT /identity/v3/projects/9c71fa31e23e4a5ea77477f81b4c5969/users/c62cea49b988422880702ee1bb045975/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:08.324013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.325133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.325609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.361294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] MFA Rules not processed for user `c62cea49b988422880702ee1bb045975`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:08.362709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:08.443023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1181/2360] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:08.455026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.457303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:08.511075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:08.527425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1f957-9b19-49c1-ac07-da312e6079b1 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.531273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcf4c-c769-412c-8a10-52b24f35eff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.531867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcf4c-c769-412c-8a10-52b24f35eff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.532142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcf4c-c769-412c-8a10-52b24f35eff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.532412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcf4c-c769-412c-8a10-52b24f35eff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.541916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdcf4c-c769-412c-8a10-52b24f35eff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.543420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdcf4c-c769-412c-8a10-52b24f35eff6 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.552761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1180/2361] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:08.575398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.649423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb08de-5934-4f2b-bb0c-21d0955024ed None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.654392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.655042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.655357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.655640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] PATH_INFO: `/v3/users/c62cea49b988422880702ee1bb045975` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.656807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62cea49b988422880702ee1bb045975)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.658766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.716366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62cea49b988422880702ee1bb045975'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:08.717321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62cea49b988422880702ee1bb045975'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:08.727434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62cea49b988422880702ee1bb045975'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:08.728075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62cea49b988422880702ee1bb045975'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:08.735187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62cea49b988422880702ee1bb045975'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:08.747789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:08.756992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1182/2362] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:08 2022] DELETE /identity/v3/users/c62cea49b988422880702ee1bb045975 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:08.761852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.763540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.763540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.785881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:08.787175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:08.852511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1181/2363] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:08.862306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:08.863817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:08.927689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731352-f2b7-4dad-8a64-c960b5b58342 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:08.931786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1997b-bd4c-4239-96c2-ac23f3a051cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:08.932512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1997b-bd4c-4239-96c2-ac23f3a051cd service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:08.932845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1997b-bd4c-4239-96c2-ac23f3a051cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:08.933057 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1997b-bd4c-4239-96c2-ac23f3a051cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:08.946211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1997b-bd4c-4239-96c2-ac23f3a051cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:08.947649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1997b-bd4c-4239-96c2-ac23f3a051cd service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:08.958748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1183/2364] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:09.259883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.261460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:09.275289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063809-6809-415a-9ba9-2a06ac2dfa4e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.280216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.281070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.281304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.281588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] PATH_INFO: `/v3/projects/9c71fa31e23e4a5ea77477f81b4c5969` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.282748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c71fa31e23e4a5ea77477f81b4c5969)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.284762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.338674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c71fa31e23e4a5ea77477f81b4c5969', 'request_id': 'req-c0fca8a0-4378-4277-8ec4-74a817a130c0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:09.345321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c71fa31e23e4a5ea77477f81b4c5969', 'request_id': 'req-c0fca8a0-4378-4277-8ec4-74a817a130c0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:09.351797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c71fa31e23e4a5ea77477f81b4c5969', 'request_id': 'req-c0fca8a0-4378-4277-8ec4-74a817a130c0'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:09.366445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] The token cache is being invalidate because project 9c71fa31e23e4a5ea77477f81b4c5969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:09.366740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:09.367427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c0fca8a0-4378-4277-8ec4-74a817a130c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:09.368982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1182/2365] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:09 2022] DELETE /identity/v3/projects/9c71fa31e23e4a5ea77477f81b4c5969 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:09.374258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c565db-bd18-4e85-acad-47806d469837 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.374615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c565db-bd18-4e85-acad-47806d469837 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.374892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c565db-bd18-4e85-acad-47806d469837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.395759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-31c565db-bd18-4e85-acad-47806d469837 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:09.396944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-31c565db-bd18-4e85-acad-47806d469837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:09.462625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1184/2366] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:09.474351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.474606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.474896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.498901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:09.500637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:09.510934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1183/2367] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:09.515456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c565db-bd18-4e85-acad-47806d469837 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.525307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c565db-bd18-4e85-acad-47806d469837 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.530267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.530863 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.531168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.531440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.532090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:09.532388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.533998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.546531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1185/2368] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:06:09.551321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.563824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c2641-bd74-45e7-bb6e-804cd81f6351 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.570138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.571447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.571882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.572159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.573037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.576135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.608078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1184/2369] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:09 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:09.612567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.623635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cbf53-22a9-4aeb-aa57-d4a538dd41a8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.683711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.684247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.684532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.684806 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.685444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.687453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.712272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1186/2370] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:09 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:09.716905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.736733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fa863-1afa-4de8-9024-696f608d7b89 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.743514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.745357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.745584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.745851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.746740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.748469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.760791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1185/2371] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:09.766085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.778858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a453-c71c-4edd-89d6-cd3249505bf5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.784908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d703b-bf0d-4194-abfd-7d8a27da4bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.785605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d703b-bf0d-4194-abfd-7d8a27da4bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.786139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d703b-bf0d-4194-abfd-7d8a27da4bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.786139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d703b-bf0d-4194-abfd-7d8a27da4bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.786717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d703b-bf0d-4194-abfd-7d8a27da4bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.788358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d703b-bf0d-4194-abfd-7d8a27da4bb8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.804003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1187/2372] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:09.805070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:09.820429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ee0a-559a-47e8-8c2c-5c85cd7729fa admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:09.831926 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bffcc7-1ea7-4515-8a7d-0ae1e9794446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:09.833425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffcc7-1ea7-4515-8a7d-0ae1e9794446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.833710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffcc7-1ea7-4515-8a7d-0ae1e9794446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.833977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bffcc7-1ea7-4515-8a7d-0ae1e9794446 admin admin] PATH_INFO: `/v3/projects/f103ec4ff3014eae8f0b8d361d46e22e/users/f0d0a1178bf64dce8c9324aa87ac986a/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.856084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bffcc7-1ea7-4515-8a7d-0ae1e9794446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f103ec4ff3014eae8f0b8d361d46e22e, user_id=f0d0a1178bf64dce8c9324aa87ac986a, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:09.859298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bffcc7-1ea7-4515-8a7d-0ae1e9794446 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:09.875264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1186/2373] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:09 2022] PUT /identity/v3/projects/f103ec4ff3014eae8f0b8d361d46e22e/users/f0d0a1178bf64dce8c9324aa87ac986a/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:09.886879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.887173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.887456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.897386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:09.921358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] MFA Rules not processed for user `f0d0a1178bf64dce8c9324aa87ac986a`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:09.922588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:09.964013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:09.964299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:09.964574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:09.972600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:09.988352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:09.989578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:10.011118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1188/2374] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:10.022322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:10.023828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:10.085425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1187/2375] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:06:10.110441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:10.111412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:10.122311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2face747-cb9d-4f9b-aa8b-ae12d859fe43 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:10.139593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f589f-b1a9-46d2-aceb-c161fa3262a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:10.140301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f589f-b1a9-46d2-aceb-c161fa3262a6 service glance] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:10.140578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f589f-b1a9-46d2-aceb-c161fa3262a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:10.140848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f589f-b1a9-46d2-aceb-c161fa3262a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:10.152357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f589f-b1a9-46d2-aceb-c161fa3262a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:10.154926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f589f-b1a9-46d2-aceb-c161fa3262a6 service glance] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:10.172951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1189/2376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:06:10.217810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9180-27ed-4c31-9995-454873aaaf58 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:10.224552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:10.225278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:10.225566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:10.225848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:10.235940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:10.237558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:10.254650 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1188/2377] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:06:15.270962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:15.271592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:15.271592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:15.301810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:15.303100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:15.312137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1190/2378] 10.222.0.83 () {58 vars in 1016 bytes} [Wed Aug 24 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:15.345265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:15.346890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:15.366147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ce157-88da-4b1c-8442-81c8e9fa4e6f service nova] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:15.375763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c47b35-8823-4e46-be82-cbdc7013f95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:15.376337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47b35-8823-4e46-be82-cbdc7013f95a service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:15.376621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47b35-8823-4e46-be82-cbdc7013f95a service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:15.376888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47b35-8823-4e46-be82-cbdc7013f95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:15.387043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47b35-8823-4e46-be82-cbdc7013f95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:15.388693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47b35-8823-4e46-be82-cbdc7013f95a service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:15.399308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1189/2379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:19.739891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:19.757667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137999a-bf9f-47d6-94df-b0e36ed45def None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:19.766519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:19.767294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:19.767636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:19.768012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:19.770604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:19.785318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:19.787597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:19.800406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1191/2380] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:06:19.855564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:19.856120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:19.856120 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:19.875185 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:19.876384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:19.935928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1190/2381] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:19.990990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:19.993260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:20.077024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee0d04-9aff-46f7-9f7e-4b8db5edb8ab service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:20.082670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19544666-b872-4838-8eba-6bfdd1abd266 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:20.083453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19544666-b872-4838-8eba-6bfdd1abd266 service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:20.083735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19544666-b872-4838-8eba-6bfdd1abd266 service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:20.083994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19544666-b872-4838-8eba-6bfdd1abd266 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:20.094835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19544666-b872-4838-8eba-6bfdd1abd266 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:20.096534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19544666-b872-4838-8eba-6bfdd1abd266 service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:20.106165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1192/2382] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:29.614733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:29.633855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530e86b-f0ba-492d-8c27-c34fa578b0e7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:29.638968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:29.639804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:29.640164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:29.640510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] PATH_INFO: `/v3/users/f0d0a1178bf64dce8c9324aa87ac986a` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:29.642040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d0a1178bf64dce8c9324aa87ac986a)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:29.644412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:29.669026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:29.747615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d0a1178bf64dce8c9324aa87ac986a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:29.748169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d0a1178bf64dce8c9324aa87ac986a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:29.748771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d0a1178bf64dce8c9324aa87ac986a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:29.757828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d0a1178bf64dce8c9324aa87ac986a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:29.765673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d0a1178bf64dce8c9324aa87ac986a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:29.795335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1191/2383] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:29 2022] DELETE /identity/v3/users/f0d0a1178bf64dce8c9324aa87ac986a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:29.797515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:29.798064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:29.798064 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:29.817086 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:29.825661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:29.826878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:29.933576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1193/2384] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:06:29.940393 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:29.942156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:30.018194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf254f4-5fbd-4df5-9c16-4a12f51cbc5c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.022687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dccf44-a0a4-4688-a67e-a30bbcc82024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.023349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dccf44-a0a4-4688-a67e-a30bbcc82024 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.023631 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dccf44-a0a4-4688-a67e-a30bbcc82024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.023904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dccf44-a0a4-4688-a67e-a30bbcc82024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.038742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dccf44-a0a4-4688-a67e-a30bbcc82024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.040712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dccf44-a0a4-4688-a67e-a30bbcc82024 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.057073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1192/2385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:30.382463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:30.384215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:30.403984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559fb15-e6ea-4a7d-b9a8-705a45cfdcf5 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.421768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.422441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.422720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.423040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] PATH_INFO: `/v3/projects/f103ec4ff3014eae8f0b8d361d46e22e` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.424393 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f103ec4ff3014eae8f0b8d361d46e22e)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.426491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.489956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f103ec4ff3014eae8f0b8d361d46e22e', 'request_id': 'req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:30.503229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f103ec4ff3014eae8f0b8d361d46e22e', 'request_id': 'req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:30.510922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f103ec4ff3014eae8f0b8d361d46e22e', 'request_id': 'req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:30.529722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] The token cache is being invalidate because project f103ec4ff3014eae8f0b8d361d46e22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:30.530016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:30.531321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5f0fc293-fa4b-40a1-b0b1-c58e2af4fceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:30.533165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1194/2386] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:30 2022] DELETE /identity/v3/projects/f103ec4ff3014eae8f0b8d361d46e22e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:30.539150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.539445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.540557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.562153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:30.563439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:30.652240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1193/2387] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:30.661529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.661816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.662092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.684429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:30.685698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:30.698767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1195/2388] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:30.705305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:30.716522 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d34a-2614-4602-ac3d-54391b058404 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.722562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.723282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.723643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.723988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.724742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:30.725113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.726750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.739128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1194/2389] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:30.743931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:30.753698 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5acd7-9346-436f-a37c-d0511f33b85e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.759244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.759440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.759754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.760023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.760677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.762724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.795992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1196/2390] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:30 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:30.797197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:30.807301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c20e5-1884-4728-adca-f1d688c9827e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.827234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:30.889655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.890274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.890550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.890817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.891478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.893403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.918722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1195/2391] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:30 2022] POST /identity/v3/users => generated 280 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:30.920184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:30.932183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ca75-27da-448d-a521-0e632608a398 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.938587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.939307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.939654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.939988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.940740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.943130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.954783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1197/2392] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:30.962780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:30.974083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b47b-c1ce-4aa4-b9dc-950ae45b4698 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:30.979096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5899dd-72e3-4807-a2cf-8cc69e22f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:30.979951 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5899dd-72e3-4807-a2cf-8cc69e22f4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:30.980232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5899dd-72e3-4807-a2cf-8cc69e22f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:30.980504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5899dd-72e3-4807-a2cf-8cc69e22f4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:30.981174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5899dd-72e3-4807-a2cf-8cc69e22f4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:30.982790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5899dd-72e3-4807-a2cf-8cc69e22f4d6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:30.995561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1196/2393] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:30.999728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:31.011487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc4339-fb25-47d8-8dba-16af1ec417db admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:31.016572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:31.017233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.017512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.017784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] PATH_INFO: `/v3/projects/579fcb87926f4e2f859baab647258607/users/3a39478dcc544e7da3a5b5b02a25b155/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.033310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579fcb87926f4e2f859baab647258607, user_id=3a39478dcc544e7da3a5b5b02a25b155, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:31.036352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:31.052346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1198/2394] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:30 2022] PUT /identity/v3/projects/579fcb87926f4e2f859baab647258607/users/3a39478dcc544e7da3a5b5b02a25b155/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:31.067537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.067819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.068072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.100963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] MFA Rules not processed for user `3a39478dcc544e7da3a5b5b02a25b155`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:31.100963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:31.173997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1197/2395] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:31.216959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:31.219481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:31.271418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:31.304224 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753c20-5216-458d-8208-0714aaea9530 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:31.308016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583406a-cc84-449e-8deb-310ba21ef810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:31.308633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583406a-cc84-449e-8deb-310ba21ef810 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.308918 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583406a-cc84-449e-8deb-310ba21ef810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.309194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583406a-cc84-449e-8deb-310ba21ef810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.317652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583406a-cc84-449e-8deb-310ba21ef810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:31.319152 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583406a-cc84-449e-8deb-310ba21ef810 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:31.328274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1199/2396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:31.344219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:31.417374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54f0e-a9b2-4064-8f67-a8563b6e556b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:31.422028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:31.422676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.422956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.424094 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] PATH_INFO: `/v3/users/3a39478dcc544e7da3a5b5b02a25b155` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.424778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a39478dcc544e7da3a5b5b02a25b155)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:31.426862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:31.467482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:31.484446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a39478dcc544e7da3a5b5b02a25b155'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:31.485583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a39478dcc544e7da3a5b5b02a25b155'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:31.486261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a39478dcc544e7da3a5b5b02a25b155'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:31.495018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a39478dcc544e7da3a5b5b02a25b155'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:31.504509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a39478dcc544e7da3a5b5b02a25b155'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:31.523660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1198/2397] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:31 2022] DELETE /identity/v3/users/3a39478dcc544e7da3a5b5b02a25b155 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:31.528225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.528515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.528790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.548697 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:31.549994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:31.623101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1200/2398] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:06:31.634937 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:31.637526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:31.702297 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbb86f-6ba4-495d-ad63-68a4bb7ac34b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:31.706446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944d840-7bf8-4a79-ac9b-b883197fc632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:31.708780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944d840-7bf8-4a79-ac9b-b883197fc632 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:31.709085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944d840-7bf8-4a79-ac9b-b883197fc632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:31.709773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944d840-7bf8-4a79-ac9b-b883197fc632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:31.723547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944d840-7bf8-4a79-ac9b-b883197fc632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:31.725029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944d840-7bf8-4a79-ac9b-b883197fc632 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:31.736081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1199/2399] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:32.295088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:32.296988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:32.341395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cb7d7-1a7c-4cd2-8cc1-7ff9b67ebb3a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:32.357789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:32.358468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.358762 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.359034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] PATH_INFO: `/v3/projects/579fcb87926f4e2f859baab647258607` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.360494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] RBAC: Authorizing `identity:delete_project(project_id=579fcb87926f4e2f859baab647258607)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:32.363480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:32.443385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579fcb87926f4e2f859baab647258607', 'request_id': 'req-b4ca5e19-67c3-485c-9c31-33ce8693190b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:32.451425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579fcb87926f4e2f859baab647258607', 'request_id': 'req-b4ca5e19-67c3-485c-9c31-33ce8693190b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:32.478126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579fcb87926f4e2f859baab647258607', 'request_id': 'req-b4ca5e19-67c3-485c-9c31-33ce8693190b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:32.497214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] The token cache is being invalidate because project 579fcb87926f4e2f859baab647258607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:32.497214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:32.498127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b4ca5e19-67c3-485c-9c31-33ce8693190b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:32.500571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1201/2400] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:32 2022] DELETE /identity/v3/projects/579fcb87926f4e2f859baab647258607 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:32.505878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.506165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.506433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.527682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:32.528939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:32.618161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1200/2401] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:32.627606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.627606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.629974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.649490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:32.650699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:32.659196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1202/2402] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:32.663641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:32.674453 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643f56a-8333-4670-aea1-5e8a1c413435 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:32.680827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:32.681476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.681749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.682033 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.682731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:32.683035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:32.684702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:32.701102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1201/2403] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:32.705764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:32.716303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0c83f-64d9-4674-a4a6-eb96908f5c00 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:32.722767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:32.723609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.724307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.724307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.725830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:32.727251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:32.761677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1203/2404] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:32 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:32.763789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:32.777358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ded6a-8f79-4be9-a600-ea14d0b13267 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:32.827523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:32.853622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:32.854306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.854583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.854853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.855538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:32.857484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:32.898981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1202/2405] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:32 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:32.902507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:32.930654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24659-b62c-400f-97c1-f3f4ef4bf96f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:32.939005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:32.939789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:32.940078 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:32.940421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:32.941356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:32.943264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:32.966134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1204/2406] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:06:32.969497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:32.996885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6134ad-5989-4f88-a5d7-717ed8bcbc7c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:33.008875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6b34a-862c-4270-8eaf-08421415abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:33.010585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6b34a-862c-4270-8eaf-08421415abb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:33.011011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6b34a-862c-4270-8eaf-08421415abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:33.011423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6b34a-862c-4270-8eaf-08421415abb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:33.012305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6b34a-862c-4270-8eaf-08421415abb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:33.014076 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6b34a-862c-4270-8eaf-08421415abb6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:33.031105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1203/2407] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:33.038591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:33.056852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf9b1-61d2-4d08-82a2-0c646ec6fc3f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:33.069659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:33.071261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:33.071856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:33.072367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] PATH_INFO: `/v3/projects/e3d601c3fea746839eb59a25fd82e2c9/users/a13682b9b89b4643ae791ded15b15e97/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:33.088300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:33.093554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d601c3fea746839eb59a25fd82e2c9, user_id=a13682b9b89b4643ae791ded15b15e97, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:33.096960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:33.124450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1205/2408] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:33 2022] PUT /identity/v3/projects/e3d601c3fea746839eb59a25fd82e2c9/users/a13682b9b89b4643ae791ded15b15e97/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:33.139105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:33.139731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:33.140264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:33.190995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] MFA Rules not processed for user `a13682b9b89b4643ae791ded15b15e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:33.192608 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:33.310915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1204/2409] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:33.323654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:33.326252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:33.397462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d27e-5dda-4680-a844-2300c14e83a5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:33.402347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d618f8-a35d-45ba-b2a3-67654387c2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:33.403428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d618f8-a35d-45ba-b2a3-67654387c2cf service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:33.403922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d618f8-a35d-45ba-b2a3-67654387c2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:33.404196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d618f8-a35d-45ba-b2a3-67654387c2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:33.416143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d618f8-a35d-45ba-b2a3-67654387c2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:33.418294 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d618f8-a35d-45ba-b2a3-67654387c2cf service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:33.430755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1206/2410] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:39.111845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:39.113838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:39.184348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec884e-225a-42fd-b409-169f927b5358 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:39.188081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:39.188722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:39.189009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:39.189279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:39.192052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:39.260918 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:39.262364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:39.266366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:39.279241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1205/2411] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:39.691658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:39.692490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:39.692906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:39.716460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:39.717754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:39.772868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1207/2412] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:39.786318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:39.787869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:39.869929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52384f6d-9c5d-4e9b-b3ae-6357f7e2e989 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:39.875397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:39.876049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:39.876315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:39.876585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:39.886265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:39.888024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:39.902478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1206/2413] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:44.292095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:44.293890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:44.388242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:44.400539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:44.419372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9cd77-faae-4694-b589-6874c983cb12 service swift] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:44.426037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:44.426763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:44.429462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:44.429755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] PATH_INFO: `/v3/users/8576deb9a96d458cba3e374b36a233b5` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:44.431492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8576deb9a96d458cba3e374b36a233b5)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:44.434256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:44.465967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330368c-d346-44bb-8835-90521ae03b18 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:44.472433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:44.473415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:44.473856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:44.474560 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:44.476651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:44.513858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:44.517239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:44.548009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8576deb9a96d458cba3e374b36a233b5'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:44.548009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8576deb9a96d458cba3e374b36a233b5'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:44.548885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8576deb9a96d458cba3e374b36a233b5'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:44.554955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1208/2414] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:44.568331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8576deb9a96d458cba3e374b36a233b5'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:44.582976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-78e9b2dd-71db-47cc-97b8-8e708d0c4ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8576deb9a96d458cba3e374b36a233b5'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:44.624026 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1207/2415] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:44 2022] DELETE /identity/v3/users/8576deb9a96d458cba3e374b36a233b5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:44.901478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:44.926610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718755b-1076-43f5-bcc3-4a7afdf225e4 service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:44.992418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:45.054381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.055244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.056283 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.056577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] PATH_INFO: `/v3/projects/98466e8254344d6aa5dd3787caabf5d0` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.057783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98466e8254344d6aa5dd3787caabf5d0)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.059945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.145745 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98466e8254344d6aa5dd3787caabf5d0', 'request_id': 'req-5c1dae32-372d-4863-b0a8-290b6efbef03'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:45.154044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98466e8254344d6aa5dd3787caabf5d0', 'request_id': 'req-5c1dae32-372d-4863-b0a8-290b6efbef03'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:45.161841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98466e8254344d6aa5dd3787caabf5d0', 'request_id': 'req-5c1dae32-372d-4863-b0a8-290b6efbef03'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:45.200699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] The token cache is being invalidate because project 98466e8254344d6aa5dd3787caabf5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:45.201143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:45.202282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5c1dae32-372d-4863-b0a8-290b6efbef03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:45.204353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1209/2416] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:44 2022] DELETE /identity/v3/projects/98466e8254344d6aa5dd3787caabf5d0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:45.209829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.210117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.210398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.231298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:45.232520 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:45.288618 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:45.300133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1208/2417] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:45.309825 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.310401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.310706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.345068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:45.346880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:45.355621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1210/2418] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:45.359940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.371460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab19b2-f8c8-4bd2-be97-eedb42655fb3 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:45.376742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.377713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.379812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.381041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.381949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:45.382263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.384016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.405688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1209/2419] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:06:45.410865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.424570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f7de-da8a-4872-a7bc-fb653d179e20 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:45.430641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.431330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.431585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.432238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.433131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.434884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.466517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1211/2420] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:45 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:06:45.470932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.484022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6417-13bc-45c7-96fb-d0cc4eeb5f8e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:45.568322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.568984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.569396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.569673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.570622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.572714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.603071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1210/2421] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:45 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:45.607371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.618540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d74c3-76f8-4b23-aded-630e1da1a831 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:45.623479 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.624094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.624372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.624645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.625347 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.627252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.638429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1212/2422] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:45.642810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.653844 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0daaf-d6d7-45f3-9ccb-c6d59c51d0d0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:45.658952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7943391-3501-4afb-a30c-03f096c191b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.660161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7943391-3501-4afb-a30c-03f096c191b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.660517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7943391-3501-4afb-a30c-03f096c191b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.660868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7943391-3501-4afb-a30c-03f096c191b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.661513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7943391-3501-4afb-a30c-03f096c191b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.663183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7943391-3501-4afb-a30c-03f096c191b7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.680562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.685497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1211/2423] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:45.697310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc463f-12f0-40c5-a0af-2e6142f038d3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:45.706809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:45.708334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.708621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.708902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] PATH_INFO: `/v3/projects/b7f881ab783c4d0e9b811abb688ceaff/users/5bc384c735fa4f59a65cf52a87797b2e/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.733573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f881ab783c4d0e9b811abb688ceaff, user_id=5bc384c735fa4f59a65cf52a87797b2e, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:45.737853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:45.760978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1213/2424] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:45 2022] PUT /identity/v3/projects/b7f881ab783c4d0e9b811abb688ceaff/users/5bc384c735fa4f59a65cf52a87797b2e/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:45.777136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:45.777810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:45.778238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:45.837174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] MFA Rules not processed for user `5bc384c735fa4f59a65cf52a87797b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:45.839388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:45.950319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1212/2425] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:45.961951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:45.963664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:46.043208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86315b5a-de64-4487-a55b-82c77abeae71 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:46.048423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdf484-24ba-486a-9952-4df48db99f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:46.051895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdf484-24ba-486a-9952-4df48db99f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:46.052322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdf484-24ba-486a-9952-4df48db99f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:46.052603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdf484-24ba-486a-9952-4df48db99f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:46.068235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:46.081351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdf484-24ba-486a-9952-4df48db99f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:46.085278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdf484-24ba-486a-9952-4df48db99f1e service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:46.100728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1214/2426] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:47.557789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:47.559934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:47.647460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:47.656901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a9801-54d2-44fb-84f0-82fa813af3cf None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:47.662833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:47.663881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:47.664270 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:47.664671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] PATH_INFO: `/v3/users/a13682b9b89b4643ae791ded15b15e97` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:47.665981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13682b9b89b4643ae791ded15b15e97)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:47.668384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:47.745356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13682b9b89b4643ae791ded15b15e97'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:47.748084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13682b9b89b4643ae791ded15b15e97'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:47.748800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13682b9b89b4643ae791ded15b15e97'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:47.766510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13682b9b89b4643ae791ded15b15e97'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:47.789441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13682b9b89b4643ae791ded15b15e97'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:47.823766 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1213/2427] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:47 2022] DELETE /identity/v3/users/a13682b9b89b4643ae791ded15b15e97 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:47.828596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:47.829187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:47.829187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:47.849647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:47.851210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:47.922702 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1215/2428] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:47.933980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:47.935855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:48.030360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806b85-c407-4e24-bad4-1049be84107e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:48.035675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:48.037509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:48.038089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:48.038768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:48.057109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:48.059594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:48.089506 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1214/2429] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:48.527462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:48.530004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:48.561902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0341bc-9919-430f-ad07-aeb0e799d575 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:48.567644 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:48.568289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:48.568564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:48.568831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] PATH_INFO: `/v3/projects/e3d601c3fea746839eb59a25fd82e2c9` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:48.570484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d601c3fea746839eb59a25fd82e2c9)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:48.572455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:48.632633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d601c3fea746839eb59a25fd82e2c9', 'request_id': 'req-3cf421b9-ef96-4d34-a818-e7337d705235'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:48.638611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d601c3fea746839eb59a25fd82e2c9', 'request_id': 'req-3cf421b9-ef96-4d34-a818-e7337d705235'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:48.649906 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d601c3fea746839eb59a25fd82e2c9', 'request_id': 'req-3cf421b9-ef96-4d34-a818-e7337d705235'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:48.665808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] The token cache is being invalidate because project e3d601c3fea746839eb59a25fd82e2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:48.666117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:48.666732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:48.668265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1216/2430] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:48 2022] DELETE /identity/v3/projects/e3d601c3fea746839eb59a25fd82e2c9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:52.824025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:52.825976 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:52.842809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29348f4e-a9de-441b-95d5-34dd48f0cb97 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:52.904987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:52.905678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:52.905952 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:52.906222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] PATH_INFO: `/v3/users/4d68264b56114ec8b0ed1d8b7e6223a1` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:52.907363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d68264b56114ec8b0ed1d8b7e6223a1)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:52.909333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:52.932367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:52.960213 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d68264b56114ec8b0ed1d8b7e6223a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:52.961221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d68264b56114ec8b0ed1d8b7e6223a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:52.961799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d68264b56114ec8b0ed1d8b7e6223a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:52.970882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d68264b56114ec8b0ed1d8b7e6223a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:52.979828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d68264b56114ec8b0ed1d8b7e6223a1'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:52.998318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1215/2431] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:52 2022] DELETE /identity/v3/users/4d68264b56114ec8b0ed1d8b7e6223a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:53.276680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:53.278843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:53.302623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf421b9-ef96-4d34-a818-e7337d705235 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:53.393289 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:53.394098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:53.394383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:53.394728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] PATH_INFO: `/v3/projects/052944b164fd43879f0d99d572c88850` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:53.396027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052944b164fd43879f0d99d572c88850)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:53.397982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:53.422949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:53.451507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052944b164fd43879f0d99d572c88850', 'request_id': 'req-6ad16c16-5472-4fc9-8a95-cfa87665f455'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:53.459595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052944b164fd43879f0d99d572c88850', 'request_id': 'req-6ad16c16-5472-4fc9-8a95-cfa87665f455'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:53.466363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052944b164fd43879f0d99d572c88850', 'request_id': 'req-6ad16c16-5472-4fc9-8a95-cfa87665f455'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:53.482147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] The token cache is being invalidate because project 052944b164fd43879f0d99d572c88850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:53.482435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:53.483071 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6ad16c16-5472-4fc9-8a95-cfa87665f455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:53.484758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1217/2432] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:53 2022] DELETE /identity/v3/projects/052944b164fd43879f0d99d572c88850 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:55.354736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:55.357059 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:55.372724 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62060cb2-3d5e-4f2a-883b-7705924afa97 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:55.434709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:55.435370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:55.435651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:55.435922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] PATH_INFO: `/v3/users/5bc384c735fa4f59a65cf52a87797b2e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:55.437045 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc384c735fa4f59a65cf52a87797b2e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:55.438977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:55.494316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc384c735fa4f59a65cf52a87797b2e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:55.495389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc384c735fa4f59a65cf52a87797b2e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:55.495888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc384c735fa4f59a65cf52a87797b2e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:55.505191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc384c735fa4f59a65cf52a87797b2e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:55.512246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc384c735fa4f59a65cf52a87797b2e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:55.534247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1216/2433] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:55 2022] DELETE /identity/v3/users/5bc384c735fa4f59a65cf52a87797b2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:55.540103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:55.540621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:55.540621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:55.562580 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:55.564089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:55.630706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1218/2434] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:55.641636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:55.643144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:55.663292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:55.708965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ccd8-ebf5-4830-bf15-3defd34391cd admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:55.713111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4bce0-8e1f-4202-8386-6d1510bac09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:55.713738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4bce0-8e1f-4202-8386-6d1510bac09f service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:55.714024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4bce0-8e1f-4202-8386-6d1510bac09f service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:55.714298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4bce0-8e1f-4202-8386-6d1510bac09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:55.724246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4bce0-8e1f-4202-8386-6d1510bac09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:55.725721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4bce0-8e1f-4202-8386-6d1510bac09f service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:55.735586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1217/2435] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:56.046038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.047445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:56.062311 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc1c8a-3d63-4889-a292-093d0c2b867f None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.068399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.069441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.069611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.070266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] PATH_INFO: `/v3/projects/b7f881ab783c4d0e9b811abb688ceaff` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.071563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f881ab783c4d0e9b811abb688ceaff)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.073564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.126513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f881ab783c4d0e9b811abb688ceaff', 'request_id': 'req-040486b3-d762-41ad-a0aa-779bdd056ed7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:56.132900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f881ab783c4d0e9b811abb688ceaff', 'request_id': 'req-040486b3-d762-41ad-a0aa-779bdd056ed7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:56.140293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f881ab783c4d0e9b811abb688ceaff', 'request_id': 'req-040486b3-d762-41ad-a0aa-779bdd056ed7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:56.155519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] The token cache is being invalidate because project b7f881ab783c4d0e9b811abb688ceaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:56.155795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:56.156444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-040486b3-d762-41ad-a0aa-779bdd056ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:56.158147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1219/2436] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:56 2022] DELETE /identity/v3/projects/b7f881ab783c4d0e9b811abb688ceaff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:56.163173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.163461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.163733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.183526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:56.184747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:56.251798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1218/2437] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:56.263852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.264171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.264440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.286739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:56.287941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:56.300155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1220/2438] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:56.304572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.316612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44d71-d7c6-46cf-bda1-69712751e43a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.322578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.323317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.323601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.323882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.324539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:56.324842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.326459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.339471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1219/2439] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:06:56.344406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.357508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90db1da-dc4c-4e9d-9691-c65ce545e8df None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.363209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.364429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.364709 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.364978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.365657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.367651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.398922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1221/2440] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:56.403229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.413811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d6fc1-6227-42b6-afc1-92985a96b59c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.483424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.484042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.484321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.484589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.485209 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.487153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.516123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1220/2441] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:56.517275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.525500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:56.529310 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01185c2b-ecc0-48da-9e3e-a6ff3be82c56 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.537949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.538851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.539506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.539781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.540438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.542080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.556139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1222/2442] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:06:56.557467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.569139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccde-bc83-445d-97cc-c83a5879eb8e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.574544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08ce51-4dfd-4863-9292-0c18427c756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.575201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08ce51-4dfd-4863-9292-0c18427c756b admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.575495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08ce51-4dfd-4863-9292-0c18427c756b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.575786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08ce51-4dfd-4863-9292-0c18427c756b admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.576413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08ce51-4dfd-4863-9292-0c18427c756b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.578049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08ce51-4dfd-4863-9292-0c18427c756b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.589637 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1221/2443] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:56.594052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.605047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773810-89cf-4fdc-8058-5dead7bbc088 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.610002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.610808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.611159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.611827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] PATH_INFO: `/v3/projects/333d3e0a0bb54d4c9ce3e824ebdc5f0e/users/a64bc410ebe84e38b599927f6d9f80cb/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.628026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333d3e0a0bb54d4c9ce3e824ebdc5f0e, user_id=a64bc410ebe84e38b599927f6d9f80cb, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.630951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.646535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1223/2444] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:56 2022] PUT /identity/v3/projects/333d3e0a0bb54d4c9ce3e824ebdc5f0e/users/a64bc410ebe84e38b599927f6d9f80cb/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:56.662523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.662820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.663091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.693592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] MFA Rules not processed for user `a64bc410ebe84e38b599927f6d9f80cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:56.695290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:56.709199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:56.769896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1222/2445] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:56.774869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.846935 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045a380-1ab4-4ea4-8456-e1054ce9afe3 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.852495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.853108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.853391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.853662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.854286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.856242 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.888245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1224/2446] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:56.892374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:56.905749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ae3b-b97a-47a1-8c91-50b661d5c03f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:56.966644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:56.967310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:56.967598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:56.967870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:56.968513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:56.970790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:56.998180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1223/2447] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:56 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:06:56.999548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:57.011081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449db1be-0a44-4951-aeee-157454bf02df admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:57.017144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:57.017999 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.018285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.018829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.021114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:57.021440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:57.037287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1225/2448] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:57.041339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:57.053492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748ccb0-736e-46b2-a66f-9a21ff5b3b78 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:57.058226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:57.059020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.059241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.059555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] PATH_INFO: `/v3/projects/4b2476c85063464c884c95e7ea67dd0a/users/38b55f04e208492cbba17524e8e5a865/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.078851 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2476c85063464c884c95e7ea67dd0a, user_id=38b55f04e208492cbba17524e8e5a865, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:57.081774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:57.100256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1224/2449] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:57 2022] PUT /identity/v3/projects/4b2476c85063464c884c95e7ea67dd0a/users/38b55f04e208492cbba17524e8e5a865/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:57.104448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:57.117974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2a7c-a608-4490-b496-915a94c15eb0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:57.190780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac70aee-fd4b-4f3d-bd91-c8ca17e42ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:57.191556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac70aee-fd4b-4f3d-bd91-c8ca17e42ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.191840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac70aee-fd4b-4f3d-bd91-c8ca17e42ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.192111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac70aee-fd4b-4f3d-bd91-c8ca17e42ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.192795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac70aee-fd4b-4f3d-bd91-c8ca17e42ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:57.194453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac70aee-fd4b-4f3d-bd91-c8ca17e42ee8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:57.216903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1226/2450] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:06:57.221333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:57.238339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290e93-226a-424e-ac0d-b128e19adfe0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:57.241392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:57.242115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.242398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.242676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] PATH_INFO: `/v3/projects/4b2476c85063464c884c95e7ea67dd0a/users/38b55f04e208492cbba17524e8e5a865/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.244634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2476c85063464c884c95e7ea67dd0a, user_id=38b55f04e208492cbba17524e8e5a865, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:57.247495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:57.259541 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1225/2451] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:06:57 2022] PUT /identity/v3/projects/4b2476c85063464c884c95e7ea67dd0a/users/38b55f04e208492cbba17524e8e5a865/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:57.272358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cf54-055d-4553-9f2c-efe1bfccd2e9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.272574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cf54-055d-4553-9f2c-efe1bfccd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.272843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cf54-055d-4553-9f2c-efe1bfccd2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.304049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-61d2cf54-055d-4553-9f2c-efe1bfccd2e9 None None] MFA Rules not processed for user `38b55f04e208492cbba17524e8e5a865`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:57.305320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-61d2cf54-055d-4553-9f2c-efe1bfccd2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:57.338266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:57.387387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1227/2452] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:06:57.399999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:57.401888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:57.466135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0bfc-d61d-476b-b01d-75016592dda7 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:57.470634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:57.471308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.471588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.471863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.484060 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:57.485551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:57.496721 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1226/2453] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:57.843317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:57.843685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:57.843685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:57.867668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:57.869558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:57.937380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1228/2454] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:57.951928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:57.953555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:57.966758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:58.012345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:58.057066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d1ef-c6b4-4a74-8cb5-2b7f1c7c82e3 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:58.063334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc58672-81a5-4a41-b70e-e40b87857ec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:58.064352 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58672-81a5-4a41-b70e-e40b87857ec9 service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:58.064783 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58672-81a5-4a41-b70e-e40b87857ec9 service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:58.065212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58672-81a5-4a41-b70e-e40b87857ec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:58.078983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc58672-81a5-4a41-b70e-e40b87857ec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:58.081437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc58672-81a5-4a41-b70e-e40b87857ec9 service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:58.092742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1227/2455] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:06:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:58.099019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8801dc-9be2-4bf9-9c5d-e6f2c48047f9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:58.103930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:58.104605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:58.104828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:58.105107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] PATH_INFO: `/v3/users/a64bc410ebe84e38b599927f6d9f80cb` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:58.106392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64bc410ebe84e38b599927f6d9f80cb)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:58.115383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:58.183640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64bc410ebe84e38b599927f6d9f80cb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:58.184166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64bc410ebe84e38b599927f6d9f80cb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:58.198108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64bc410ebe84e38b599927f6d9f80cb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:58.198788 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64bc410ebe84e38b599927f6d9f80cb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:58.209174 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64bc410ebe84e38b599927f6d9f80cb'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:58.216951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:58.244288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1229/2456] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:58 2022] DELETE /identity/v3/users/a64bc410ebe84e38b599927f6d9f80cb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:06:58.248126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:58.249535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:58.250574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:58.286069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:58.287740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:58.405567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1228/2457] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:58.413761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:58.415571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:58.517957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46cee-88f3-4c40-b446-7fada4e35842 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:58.522320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:58.523006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:58.523263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:58.523539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:58.535339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:58.537876 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:58.555625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1230/2458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:06:58.937299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:58.939252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:58.955534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9197ed-5d24-472f-8871-25cb3fa67c68 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:58.960584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:58.961534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:58.961806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:58.962235 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] PATH_INFO: `/v3/projects/333d3e0a0bb54d4c9ce3e824ebdc5f0e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:58.963562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333d3e0a0bb54d4c9ce3e824ebdc5f0e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:58.965592 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:59.019312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333d3e0a0bb54d4c9ce3e824ebdc5f0e', 'request_id': 'req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.026846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333d3e0a0bb54d4c9ce3e824ebdc5f0e', 'request_id': 'req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.033265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333d3e0a0bb54d4c9ce3e824ebdc5f0e', 'request_id': 'req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.047750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] The token cache is being invalidate because project 333d3e0a0bb54d4c9ce3e824ebdc5f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:59.048039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.049126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.050648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1229/2459] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:58 2022] DELETE /identity/v3/projects/333d3e0a0bb54d4c9ce3e824ebdc5f0e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:59.055198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:59.068596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797bb40-a25c-42ca-a863-4376029b9636 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:59.133276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:59.133821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:59.134096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:59.134389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] PATH_INFO: `/v3/users/38b55f04e208492cbba17524e8e5a865` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:59.135592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b55f04e208492cbba17524e8e5a865)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:59.137527 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:59.192542 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b55f04e208492cbba17524e8e5a865'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.193257 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b55f04e208492cbba17524e8e5a865'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.202943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b55f04e208492cbba17524e8e5a865'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.203688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b55f04e208492cbba17524e8e5a865'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.213129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-4f0d76a0-683d-4e4f-9b59-1e27c45f89b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b55f04e208492cbba17524e8e5a865'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.233567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1231/2460] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:06:59 2022] DELETE /identity/v3/users/38b55f04e208492cbba17524e8e5a865 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:59.533807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:59.535807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:59.549116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69872-6c18-4605-b1cd-54e90e5b6ad7 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:59.572488 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:59.618175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:59.618830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:59.619141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:59.619422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] PATH_INFO: `/v3/projects/4b2476c85063464c884c95e7ea67dd0a` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:59.620579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2476c85063464c884c95e7ea67dd0a)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:59.622508 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:59.674958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2476c85063464c884c95e7ea67dd0a', 'request_id': 'req-92ec0e7a-3c38-4026-84d8-d361e06d3efb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.686557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2476c85063464c884c95e7ea67dd0a', 'request_id': 'req-92ec0e7a-3c38-4026-84d8-d361e06d3efb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.703956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2476c85063464c884c95e7ea67dd0a', 'request_id': 'req-92ec0e7a-3c38-4026-84d8-d361e06d3efb'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.723043 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] The token cache is being invalidate because project 4b2476c85063464c884c95e7ea67dd0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:06:59.723367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.724527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-92ec0e7a-3c38-4026-84d8-d361e06d3efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:06:59.727156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1230/2461] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:06:59 2022] DELETE /identity/v3/projects/4b2476c85063464c884c95e7ea67dd0a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:06:59.732663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:59.733056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:59.733492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:59.755874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:59.757301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:59.764216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:59.836139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1232/2462] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:59.843885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:59.844291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:59.844700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:59.882635 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:06:59.884525 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:06:59.897137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1231/2463] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:06:59.901465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:59.912212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551790a-9a01-47e8-95b7-067aadd031e0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:59.917512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:59.918136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:59.918423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:59.919094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:59.919384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:06:59.919690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:59.921325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:59.934758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1233/2464] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:06:59.939196 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:06:59.949247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0c54-6556-4e5f-9b15-d973200f6521 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:06:59.953960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:06:59.954639 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:06:59.954982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:06:59.955354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:06:59.955993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:06:59.958262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:06:59.987433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1232/2465] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:06:59 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:06:59.992155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.002012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a967b6-a54c-4cf0-9d41-39d79e259554 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.060536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.061287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.061662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.061940 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.062563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.064539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.090473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1234/2466] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:06:59 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:00.094923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.109784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5d21-eaf0-4d71-b3ef-0b4f25f6b305 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.115417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.116028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.116309 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.116579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.117263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.119081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.130795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1233/2467] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:00.134901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.148476 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b19e-2aee-4533-bf5a-429f88eb71f5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.153941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe123b4-e708-4221-8738-287b32c304e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.154789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe123b4-e708-4221-8738-287b32c304e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.155233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe123b4-e708-4221-8738-287b32c304e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.155639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe123b4-e708-4221-8738-287b32c304e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.156579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe123b4-e708-4221-8738-287b32c304e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.158978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe123b4-e708-4221-8738-287b32c304e2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.170821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1235/2468] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:00.175709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.189645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8003588-f9ac-4e07-bba8-d807ea1bb21f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.195957 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.196642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.196924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.197197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] PATH_INFO: `/v3/projects/6cd6d4615bc347cb88f182e7e3411a94/users/5c7098d28a2345169344f4113a3d911b/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.216428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd6d4615bc347cb88f182e7e3411a94, user_id=5c7098d28a2345169344f4113a3d911b, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.219188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.235917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1234/2469] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:00 2022] PUT /identity/v3/projects/6cd6d4615bc347cb88f182e7e3411a94/users/5c7098d28a2345169344f4113a3d911b/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:00.252038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.252352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.252668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.291662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] MFA Rules not processed for user `5c7098d28a2345169344f4113a3d911b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:00.292874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:00.363129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1236/2470] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:00.369491 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.424147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:00.439316 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e790-e6ab-4ea5-a22c-5736d227d272 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.443867 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.444472 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.445082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.445337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.445947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.447977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.475950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1235/2471] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:00 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:00.480499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.493032 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678ebed-9976-44e6-9b2e-6d663d32cd5e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.496625 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:00.558223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.558868 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.559192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.559478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.560144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.562133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.587590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1237/2472] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:00 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:00.592041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.604897 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950044-81bd-4629-ab4c-5b30317bd363 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.610902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.612100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.612287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.612743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.613664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.615743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.629854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1236/2473] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:00.634248 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.648716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac8037-f5df-4781-b06c-80521f37e428 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.655288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.655929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.656229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.656473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] PATH_INFO: `/v3/projects/7bd2e20d3812473d849095c81c6ad3cd/users/63047a0c4060444fa0af33919e7b6201/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.674389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd2e20d3812473d849095c81c6ad3cd, user_id=63047a0c4060444fa0af33919e7b6201, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.677553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.696026 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1238/2474] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:00 2022] PUT /identity/v3/projects/7bd2e20d3812473d849095c81c6ad3cd/users/63047a0c4060444fa0af33919e7b6201/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:00.700542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.714203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea98d7-2f44-456b-970e-e53fb1443402 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.792569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aa394-0668-4e9a-bb19-487047743716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.793373 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aa394-0668-4e9a-bb19-487047743716 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.793760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aa394-0668-4e9a-bb19-487047743716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.794119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aa394-0668-4e9a-bb19-487047743716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.795106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70aa394-0668-4e9a-bb19-487047743716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.797633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70aa394-0668-4e9a-bb19-487047743716 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.809968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1237/2475] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:00.814385 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.825627 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ade0-0cd4-4903-b1a5-8367416bf6fe admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:00.831002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:00.831716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.832407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.832407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] PATH_INFO: `/v3/projects/7bd2e20d3812473d849095c81c6ad3cd/users/63047a0c4060444fa0af33919e7b6201/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.834451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd2e20d3812473d849095c81c6ad3cd, user_id=63047a0c4060444fa0af33919e7b6201, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:00.837138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:00.848171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1239/2476] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:00 2022] PUT /identity/v3/projects/7bd2e20d3812473d849095c81c6ad3cd/users/63047a0c4060444fa0af33919e7b6201/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:00.859794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:00.860137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:00.860419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:00.890752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] MFA Rules not processed for user `63047a0c4060444fa0af33919e7b6201`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:00.892018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:00.968517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1238/2477] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:00.979921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:00.981669 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:01.047317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265dd5-61b6-4d21-a883-2824acc48850 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:01.051598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d403683-c33d-4472-a56c-6984f6348b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:01.052203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d403683-c33d-4472-a56c-6984f6348b5f service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:01.052525 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d403683-c33d-4472-a56c-6984f6348b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:01.052796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d403683-c33d-4472-a56c-6984f6348b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:01.062703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d403683-c33d-4472-a56c-6984f6348b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:01.064239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d403683-c33d-4472-a56c-6984f6348b5f service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:01.074974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1240/2478] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:02.638921 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:02.694663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:02.716319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf4109-a3a1-409a-b22d-42ee9982a14d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:02.720980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:02.721613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:02.721889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:02.722156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] PATH_INFO: `/v3/users/5c7098d28a2345169344f4113a3d911b` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:02.723542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7098d28a2345169344f4113a3d911b)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:02.725825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:02.781187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7098d28a2345169344f4113a3d911b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:02.781947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7098d28a2345169344f4113a3d911b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:02.783672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7098d28a2345169344f4113a3d911b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:02.798742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7098d28a2345169344f4113a3d911b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:02.808557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7098d28a2345169344f4113a3d911b'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:02.827656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1239/2479] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:02 2022] DELETE /identity/v3/users/5c7098d28a2345169344f4113a3d911b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:02.832659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:02.833222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:02.833222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:02.852764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:02.854070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:02.915604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1241/2480] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:02.925852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:02.928278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:02.996861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0037a-da25-441b-813e-de946fb3b70b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:03.001018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:03.001677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:03.002010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:03.002285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:03.012451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:03.013959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:03.024049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1240/2481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:03.329474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:03.331396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:03.339201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:03.347690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d693c3-edf7-4f89-9842-622a46b9a80a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:03.354343 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:03.356320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:03.356776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:03.356878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] PATH_INFO: `/v3/projects/6cd6d4615bc347cb88f182e7e3411a94` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:03.358140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd6d4615bc347cb88f182e7e3411a94)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:03.360217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:03.410271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd6d4615bc347cb88f182e7e3411a94', 'request_id': 'req-e8df89da-0c8f-473d-a673-530c8a2ffbc2'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.416608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd6d4615bc347cb88f182e7e3411a94', 'request_id': 'req-e8df89da-0c8f-473d-a673-530c8a2ffbc2'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.423261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd6d4615bc347cb88f182e7e3411a94', 'request_id': 'req-e8df89da-0c8f-473d-a673-530c8a2ffbc2'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.437869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] The token cache is being invalidate because project 6cd6d4615bc347cb88f182e7e3411a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:03.438183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.438840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.440429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1242/2482] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:03 2022] DELETE /identity/v3/projects/6cd6d4615bc347cb88f182e7e3411a94 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:03.445194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:03.455581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ccb6b-e76f-45d1-8aaa-9ace2fb6b9f9 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:03.528349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:03.529014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:03.529272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:03.529546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] PATH_INFO: `/v3/users/63047a0c4060444fa0af33919e7b6201` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:03.530726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63047a0c4060444fa0af33919e7b6201)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:03.532729 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:03.539034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:03.597750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63047a0c4060444fa0af33919e7b6201'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.598569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63047a0c4060444fa0af33919e7b6201'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.599384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63047a0c4060444fa0af33919e7b6201'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.610463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63047a0c4060444fa0af33919e7b6201'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.618740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63047a0c4060444fa0af33919e7b6201'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:03.640050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1241/2483] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:03 2022] DELETE /identity/v3/users/63047a0c4060444fa0af33919e7b6201 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:03.925047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:03.926602 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:03.940448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df89da-0c8f-473d-a673-530c8a2ffbc2 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:03.962458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:03.964872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:04.003651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.004429 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.004771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.005049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] PATH_INFO: `/v3/projects/7bd2e20d3812473d849095c81c6ad3cd` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.006382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd2e20d3812473d849095c81c6ad3cd)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.008505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.026589 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e20d1-be50-4680-bb5c-bc71eace5080 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.030258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.030936 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.031259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.031534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.033602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:04.047611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.049074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a73d4-cf4e-4824-b7ac-c1f69bbe5799 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.058725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd2e20d3812473d849095c81c6ad3cd', 'request_id': 'req-5e209d92-a119-4e9f-b890-48e4b07961af'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:04.059444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1242/2484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:04.064684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd2e20d3812473d849095c81c6ad3cd', 'request_id': 'req-5e209d92-a119-4e9f-b890-48e4b07961af'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:04.072887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd2e20d3812473d849095c81c6ad3cd', 'request_id': 'req-5e209d92-a119-4e9f-b890-48e4b07961af'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:04.085977 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] The token cache is being invalidate because project 7bd2e20d3812473d849095c81c6ad3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:04.086299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:04.087189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5e209d92-a119-4e9f-b890-48e4b07961af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:04.088757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1243/2485] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:03 2022] DELETE /identity/v3/projects/7bd2e20d3812473d849095c81c6ad3cd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:04.093668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.093953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.094201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.115359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:04.116636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:04.183179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1243/2486] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:04.191968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.192450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.192887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.215376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:04.216754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:04.226044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1244/2487] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:04.230234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.241008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254dbbb-567a-4748-af12-d62bb4996a09 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.246383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.247009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.247317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.247602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.248252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:04.248564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.250314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.263466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1244/2488] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:07:04.268085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.278568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a63155-d258-4b36-b814-10efb1f61d3e None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.284181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.284801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.285083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.285401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.286306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.288203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.294160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:04.322541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1245/2489] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:04.326892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.337962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19ff0-93f3-4324-a8b3-2c420374b209 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.353642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:04.403796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.404341 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.404620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.404892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.405527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.407498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.435231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1245/2490] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:04.441080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.454171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90568c01-8831-4475-94c0-a5083185bf38 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.459673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.460326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.460620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.460849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.461518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.463215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.474586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1246/2491] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:04.479122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.490301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53100e43-9c0f-479f-aaaf-440423d565fd admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.495411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b14cf-997d-4547-9074-22a6eb62885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.496066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b14cf-997d-4547-9074-22a6eb62885d admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.496351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b14cf-997d-4547-9074-22a6eb62885d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.496615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b14cf-997d-4547-9074-22a6eb62885d admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.497442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b14cf-997d-4547-9074-22a6eb62885d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.499090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b14cf-997d-4547-9074-22a6eb62885d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.510805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1246/2492] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:04.515504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.529202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42652481-e257-41d3-a66e-a7971bec5023 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.534853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.536150 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.536277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.536451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] PATH_INFO: `/v3/projects/45c258b4b1b24be89191c46c87239648/users/d83830ea7a0c42ea92d87f45a61d8145/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.552803 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c258b4b1b24be89191c46c87239648, user_id=d83830ea7a0c42ea92d87f45a61d8145, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.555639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.572584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1247/2493] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:04 2022] PUT /identity/v3/projects/45c258b4b1b24be89191c46c87239648/users/d83830ea7a0c42ea92d87f45a61d8145/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:04.584262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.584547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.584824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.612636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] MFA Rules not processed for user `d83830ea7a0c42ea92d87f45a61d8145`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:04.614458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:04.684812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1247/2494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:04.690085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.759843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f5d76-548a-41e8-8008-8edb5e763cc6 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.764885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.765565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.765842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.766113 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.766795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.769103 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.802723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1248/2495] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:04.807525 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.823812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb877-ec0a-4718-95e2-f03ca5362cd5 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.896423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.897068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.897348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.897621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.898587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.901362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.926339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1248/2496] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:04 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:04.932885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.945173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02e506-8b1f-4bf2-a431-36f5a775ea46 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.951666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.952318 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.952579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.952854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:04.953541 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:04.955258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:04.970017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1249/2497] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:04.974713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:04.985733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518712c-0ad4-49de-b6e3-efba0f0e0096 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:04.990672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:04.991405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:04.991685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:04.991959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] PATH_INFO: `/v3/projects/ae2dde6955a44e6a859b52a71a485cfb/users/7efd2df4d73e4a6e87ff843346355c62/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.007967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:05.013571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2dde6955a44e6a859b52a71a485cfb, user_id=7efd2df4d73e4a6e87ff843346355c62, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:05.016771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:05.040731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1249/2498] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:04 2022] PUT /identity/v3/projects/ae2dde6955a44e6a859b52a71a485cfb/users/7efd2df4d73e4a6e87ff843346355c62/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:05.045024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:05.057596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f7fb1-bc6a-4564-aedc-3713a82594fb admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:05.139019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679cf56-cfee-4a62-8a7c-802b2a899c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:05.141167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cf56-cfee-4a62-8a7c-802b2a899c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.141471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cf56-cfee-4a62-8a7c-802b2a899c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.142288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cf56-cfee-4a62-8a7c-802b2a899c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.143024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cf56-cfee-4a62-8a7c-802b2a899c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:05.146510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cf56-cfee-4a62-8a7c-802b2a899c1f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:05.166380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1250/2499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:05.170835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:05.183100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a9de-43b6-4fdb-9bc4-45f0a62068ae admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:05.188780 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:05.189180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.189558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.189902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] PATH_INFO: `/v3/projects/ae2dde6955a44e6a859b52a71a485cfb/users/7efd2df4d73e4a6e87ff843346355c62/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.192431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2dde6955a44e6a859b52a71a485cfb, user_id=7efd2df4d73e4a6e87ff843346355c62, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:05.197165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:05.215114 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1250/2500] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:05 2022] PUT /identity/v3/projects/ae2dde6955a44e6a859b52a71a485cfb/users/7efd2df4d73e4a6e87ff843346355c62/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:05.226493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.226815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.227168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.255917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] MFA Rules not processed for user `7efd2df4d73e4a6e87ff843346355c62`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:05.257142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:05.266570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:05.334822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1251/2501] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:05.346195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:05.348079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:05.413513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368d0e-7808-4422-a824-e597d3095a03 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:05.417853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d149e1f-19b9-40e3-84cf-cd3dbbd979d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:05.418465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d149e1f-19b9-40e3-84cf-cd3dbbd979d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.418740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d149e1f-19b9-40e3-84cf-cd3dbbd979d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.419007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d149e1f-19b9-40e3-84cf-cd3dbbd979d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.428266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d149e1f-19b9-40e3-84cf-cd3dbbd979d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:05.429697 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d149e1f-19b9-40e3-84cf-cd3dbbd979d4 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:05.439369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1251/2502] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:05.505916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:05.588301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d359206-6036-477e-bf05-bb6729f2470d None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:05.593055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:05.594143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.594143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.594362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] PATH_INFO: `/v3/users/d83830ea7a0c42ea92d87f45a61d8145` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.595575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83830ea7a0c42ea92d87f45a61d8145)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:05.597529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:05.652923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83830ea7a0c42ea92d87f45a61d8145'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:05.653649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83830ea7a0c42ea92d87f45a61d8145'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:05.661196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83830ea7a0c42ea92d87f45a61d8145'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:05.662288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83830ea7a0c42ea92d87f45a61d8145'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:05.670816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83830ea7a0c42ea92d87f45a61d8145'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:05.690487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1252/2503] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:05 2022] DELETE /identity/v3/users/d83830ea7a0c42ea92d87f45a61d8145 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:05.695342 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.695858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.695858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.715426 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:05.716327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:05.778146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1252/2504] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:05.788751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:05.791281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:05.830022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:05.864041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4bbea-edea-436d-9af7-71e83779ac8a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:05.868782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:05.869753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:05.869878 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:05.870173 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:05.881436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:05.883202 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:05.894759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1253/2505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:06.196499 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:06.198343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:06.217219 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4574635-91f7-4f83-a4f8-fc8196bc650f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:06.223630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:06.224555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:06.224979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:06.225370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] PATH_INFO: `/v3/projects/45c258b4b1b24be89191c46c87239648` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:06.226800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c258b4b1b24be89191c46c87239648)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:06.229236 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:06.285682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c258b4b1b24be89191c46c87239648', 'request_id': 'req-77c93213-279b-4c65-b1cb-0b84b44cf2fc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.292121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c258b4b1b24be89191c46c87239648', 'request_id': 'req-77c93213-279b-4c65-b1cb-0b84b44cf2fc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.297716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c258b4b1b24be89191c46c87239648', 'request_id': 'req-77c93213-279b-4c65-b1cb-0b84b44cf2fc'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.311144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] The token cache is being invalidate because project 45c258b4b1b24be89191c46c87239648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:06.311434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.312071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.314195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1253/2506] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:06 2022] DELETE /identity/v3/projects/45c258b4b1b24be89191c46c87239648 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:06.318519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:06.328233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4691d-d404-4264-b76b-db9bc1084ed2 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:06.400353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:06.401029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:06.401323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:06.401583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] PATH_INFO: `/v3/users/7efd2df4d73e4a6e87ff843346355c62` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:06.402713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efd2df4d73e4a6e87ff843346355c62)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:06.404899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:06.464680 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efd2df4d73e4a6e87ff843346355c62'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.465229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efd2df4d73e4a6e87ff843346355c62'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.475752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efd2df4d73e4a6e87ff843346355c62'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.476566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efd2df4d73e4a6e87ff843346355c62'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.484446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce044279-c01c-4537-8ce6-042c85419d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efd2df4d73e4a6e87ff843346355c62'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:06.509258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1254/2507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:06 2022] DELETE /identity/v3/users/7efd2df4d73e4a6e87ff843346355c62 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:06.936322 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:06.938318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:06.957497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:06.970272 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93213-279b-4c65-b1cb-0b84b44cf2fc admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.034790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.035074 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.035181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.035757 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] PATH_INFO: `/v3/projects/ae2dde6955a44e6a859b52a71a485cfb` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.036854 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2dde6955a44e6a859b52a71a485cfb)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.038906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.101505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2dde6955a44e6a859b52a71a485cfb', 'request_id': 'req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.109298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2dde6955a44e6a859b52a71a485cfb', 'request_id': 'req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.117334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2dde6955a44e6a859b52a71a485cfb', 'request_id': 'req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.138124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] The token cache is being invalidate because project ae2dde6955a44e6a859b52a71a485cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:07.138701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.139799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-4d0ccabe-be16-41bd-9100-6d7d60dd61ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.145710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1254/2508] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:06 2022] DELETE /identity/v3/projects/ae2dde6955a44e6a859b52a71a485cfb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:07.148269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.148746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.149025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.182973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:07.184281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:07.253793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:07.276225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1255/2509] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:07.283730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.284014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.284288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.307025 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:07.308471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:07.318810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1255/2510] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:07.323854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.333703 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fa853-d922-45f0-8a7b-0fb5a6955666 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.339017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.339808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.340151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.340482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.341225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:07.341586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.347581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.361223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1256/2511] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:07.365677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.378824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f1655-e320-4580-b96f-365f62cef6dc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.384686 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.385314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.385633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.386710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.387383 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.399526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.432734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1256/2512] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:07.438020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.449233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1db40-71fe-4057-b28d-6b77e90f4329 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.510853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.511494 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.511777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.512211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.512693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.514706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.543641 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1257/2513] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:07.546132 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.556770 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4683f-4a25-4a91-a5de-2198f940a85c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.561598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.562138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.562442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.562717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.563386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.564967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.575889 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1257/2514] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:07.583817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.597725 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fa368-38a2-4c67-a7ec-7d010dc8fe0f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.598773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.600762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:07.604050 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.604682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.604965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.605241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.606039 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.607713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.617786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fd898-ee06-4b29-947c-328d019d62e0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.621158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1258/2515] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:07.623369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.623992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.624274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.624548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] PATH_INFO: `/v3/users/9579f6a06b1743039bb5c3db8e88e460` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.625433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.625673 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9579f6a06b1743039bb5c3db8e88e460)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.627642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.636817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a682b-8098-486c-8917-df733a646014 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.641728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666da0e-a4c4-4c0f-bded-46969464db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.642391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666da0e-a4c4-4c0f-bded-46969464db50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.642656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666da0e-a4c4-4c0f-bded-46969464db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.642927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666da0e-a4c4-4c0f-bded-46969464db50 admin admin] PATH_INFO: `/v3/projects/23f6a83dd2904b3b8b849b8c2cc31312/users/3eb4c8f45829436a9808bb87d0a84084/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.659643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666da0e-a4c4-4c0f-bded-46969464db50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f6a83dd2904b3b8b849b8c2cc31312, user_id=3eb4c8f45829436a9808bb87d0a84084, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.662544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666da0e-a4c4-4c0f-bded-46969464db50 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.675243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1259/2516] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:07 2022] PUT /identity/v3/projects/23f6a83dd2904b3b8b849b8c2cc31312/users/3eb4c8f45829436a9808bb87d0a84084/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:07.682481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9579f6a06b1743039bb5c3db8e88e460'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.683186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9579f6a06b1743039bb5c3db8e88e460'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.683823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9579f6a06b1743039bb5c3db8e88e460'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.685813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:07.687395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.687773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.688165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.693068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9579f6a06b1743039bb5c3db8e88e460'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.702817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9579f6a06b1743039bb5c3db8e88e460'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:07.719211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] MFA Rules not processed for user `3eb4c8f45829436a9808bb87d0a84084`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:07.720439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:07.720692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1258/2517] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:07 2022] DELETE /identity/v3/users/9579f6a06b1743039bb5c3db8e88e460 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:07.790075 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1260/2518] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:07.794759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.796188 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:07.870880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e739a5-523e-44c9-bc06-035374e663a5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.875992 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.876611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.876928 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.877197 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.877809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.880180 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:07.917726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.917909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1259/2519] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:07.918745 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:07.919418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:07.935338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3afca-7dd1-4a4c-a76e-168165663af8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.964356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:07.986674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8808d-27ec-424d-8fb2-a077acff2875 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:07.992191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:07.992891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:07.993262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:07.993603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:07.994303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:07.996280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.007799 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.008442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.008724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.008997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] PATH_INFO: `/v3/projects/aba1b22e54104a8b8dd8bf06bb319dbe` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.010435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba1b22e54104a8b8dd8bf06bb319dbe)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.012740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.019490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1260/2520] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:07 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:08.023815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.033652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d8c9-beec-406b-92ff-3fbb41017707 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.039804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.040409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.040685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.041355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.042009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.044170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.056028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1261/2521] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:08.060403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.065695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba1b22e54104a8b8dd8bf06bb319dbe', 'request_id': 'req-65f9ed24-d930-4b69-847a-73fda470f1da'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:08.070907 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24fd29-c550-45f2-b67a-0f1c34bfc097 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.071892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba1b22e54104a8b8dd8bf06bb319dbe', 'request_id': 'req-65f9ed24-d930-4b69-847a-73fda470f1da'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:08.078574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba1b22e54104a8b8dd8bf06bb319dbe', 'request_id': 'req-65f9ed24-d930-4b69-847a-73fda470f1da'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:08.095345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] The token cache is being invalidate because project aba1b22e54104a8b8dd8bf06bb319dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:08.095635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:08.096296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65f9ed24-d930-4b69-847a-73fda470f1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:08.097867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1261/2522] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:07 2022] DELETE /identity/v3/projects/aba1b22e54104a8b8dd8bf06bb319dbe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:08.098421 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:08.103076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b739-1a2f-475e-a927-64a5ad567098 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.103398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b739-1a2f-475e-a927-64a5ad567098 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.103679 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b739-1a2f-475e-a927-64a5ad567098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.127209 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0134b739-1a2f-475e-a927-64a5ad567098 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:08.128453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0134b739-1a2f-475e-a927-64a5ad567098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.136576 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.137386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.137667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.137938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] PATH_INFO: `/v3/projects/59e01fedb46e4a708e25a73fdbb305fe/users/6584d34689664c859d80f10f868d304b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.153096 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e01fedb46e4a708e25a73fdbb305fe, user_id=6584d34689664c859d80f10f868d304b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.155871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.169715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1262/2523] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:08 2022] PUT /identity/v3/projects/59e01fedb46e4a708e25a73fdbb305fe/users/6584d34689664c859d80f10f868d304b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:08.173797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.175501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.200221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1262/2524] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:08.209780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.210081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.210348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.230780 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:08.232068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.241159 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1263/2525] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:08.244842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6921-ff5d-49ad-9868-bbec478df5b4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.245543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.249536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.250202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.250482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.250761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.251454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.253079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.255099 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1d2c-08c7-4164-9697-4f6b0a80610a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.260215 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.260820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.261094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.261356 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.262022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:08.262326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.263860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1263/2526] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:08.264143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.268152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.278252 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaa590-7cf3-4202-ab11-b32df8ff0cb8 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.279510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1264/2527] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:08.283294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06074bb-56d1-406d-9a29-9a08db77ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.283977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06074bb-56d1-406d-9a29-9a08db77ead6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.284136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.284253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06074bb-56d1-406d-9a29-9a08db77ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.284528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06074bb-56d1-406d-9a29-9a08db77ead6 admin admin] PATH_INFO: `/v3/projects/59e01fedb46e4a708e25a73fdbb305fe/users/6584d34689664c859d80f10f868d304b/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.286779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06074bb-56d1-406d-9a29-9a08db77ead6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e01fedb46e4a708e25a73fdbb305fe, user_id=6584d34689664c859d80f10f868d304b, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.289868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06074bb-56d1-406d-9a29-9a08db77ead6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.294231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfe09e-7733-4039-aef0-e763b02b4e1a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.298834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.299473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.299752 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.300027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.300659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.301681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1264/2528] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:08 2022] PUT /identity/v3/projects/59e01fedb46e4a708e25a73fdbb305fe/users/6584d34689664c859d80f10f868d304b/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:08.302829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.312784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.313078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.313355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.334069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1265/2529] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:08.338485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.345020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] MFA Rules not processed for user `6584d34689664c859d80f10f868d304b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:08.346294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.348142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:08.405411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8aa5c-d5a7-4ac1-b818-e08db9c10f67 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.410049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.410843 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.411156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.411443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.412055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.414033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.419945 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1265/2530] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:08.432262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.433893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.438440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1266/2531] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:08.442812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.452847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27dd29-cc41-447e-b975-a1932233bf48 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.458579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:08.458808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.459466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.459764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.460143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.461063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.462724 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.474540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1267/2532] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:08.478301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.488313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb077a-9c39-43cd-8814-8fd72105049a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.493313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.494029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.494315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.494590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.495279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.496908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.501064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae46473-08e8-4b51-9bf0-d3cf4e8b6b66 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.506338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.506979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.507289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.507559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.509165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1268/2533] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:08.512517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.513409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.523772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63e9b4-4b9d-43a2-971a-7a0c4da9def5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.529246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b068-5164-47e6-bde2-2654881e4681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.530049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b068-5164-47e6-bde2-2654881e4681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.530338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b068-5164-47e6-bde2-2654881e4681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.530601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b068-5164-47e6-bde2-2654881e4681 admin admin] PATH_INFO: `/v3/projects/ef4ebb0f918248bea1a0cfa5aa5af708/users/001f469d426e4639bd674ab41cc6422e/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.545573 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746b068-5164-47e6-bde2-2654881e4681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4ebb0f918248bea1a0cfa5aa5af708, user_id=001f469d426e4639bd674ab41cc6422e, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.548328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746b068-5164-47e6-bde2-2654881e4681 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.562153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1269/2534] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:08 2022] PUT /identity/v3/projects/ef4ebb0f918248bea1a0cfa5aa5af708/users/001f469d426e4639bd674ab41cc6422e/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:08.573850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.574136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.574414 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.578366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.579864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.589018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1266/2535] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:08.603035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] MFA Rules not processed for user `001f469d426e4639bd674ab41cc6422e`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:08.604287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:08.684677 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1270/2536] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:08.689436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.702933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e508157-74d3-4e37-8c2b-988c3cea63a7 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.766743 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.767396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.767682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.767959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.768622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.771233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.799259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1267/2537] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:08.803983 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.817282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7f3d5-d20e-4298-a4e7-dee894f57ba8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.863120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:08.882418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.883465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.883811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.884157 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.884832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.887216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.915496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1271/2538] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:08 2022] POST /identity/v3/users => generated 306 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:08.920439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.933444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c89afa-7522-46fd-915e-47a1a60c8b9a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.940611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.942260 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.942941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.943434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.944291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:08.946914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:08.962005 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1268/2539] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:08.966153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:08.979175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e72e2d-7fba-414a-b83c-461494348f55 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:08.982093 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:08.982759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:08.983036 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:08.983372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] PATH_INFO: `/v3/projects/9550fc6266d7486fbb5ec752377e2527/users/b1185ae6f9564512aec16e41903b1367/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:08.998682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9550fc6266d7486fbb5ec752377e2527, user_id=b1185ae6f9564512aec16e41903b1367, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:09.001409 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:09.016006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1272/2540] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:08 2022] PUT /identity/v3/projects/9550fc6266d7486fbb5ec752377e2527/users/b1185ae6f9564512aec16e41903b1367/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:09.020416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:09.030791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534df2-de3a-439b-841e-7bf912f75e4e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:09.076668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:09.090165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abdaa9-4b96-4604-b0ea-6346cdf0f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:09.090829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abdaa9-4b96-4604-b0ea-6346cdf0f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:09.091137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abdaa9-4b96-4604-b0ea-6346cdf0f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:09.091414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abdaa9-4b96-4604-b0ea-6346cdf0f5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:09.092106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abdaa9-4b96-4604-b0ea-6346cdf0f5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:09.093971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abdaa9-4b96-4604-b0ea-6346cdf0f5c7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:09.104876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1269/2541] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:09.109413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:09.121460 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d10e0-df71-48f1-8b23-a62e127cda64 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:09.126632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:09.127336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:09.127610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:09.127879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] PATH_INFO: `/v3/projects/9550fc6266d7486fbb5ec752377e2527/users/b1185ae6f9564512aec16e41903b1367/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:09.135738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9550fc6266d7486fbb5ec752377e2527, user_id=b1185ae6f9564512aec16e41903b1367, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:09.138435 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:09.151235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1273/2542] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:09 2022] PUT /identity/v3/projects/9550fc6266d7486fbb5ec752377e2527/users/b1185ae6f9564512aec16e41903b1367/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:09.162088 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:09.162374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:09.162647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:09.206134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] MFA Rules not processed for user `b1185ae6f9564512aec16e41903b1367`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:09.207361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:09.287303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1270/2543] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:09.300975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:09.302847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:09.372068 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5fcb5-65d5-4d13-8631-88d5d89d8b5b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:09.376217 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:09.376839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:09.377128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:09.377400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:09.388243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:09.389730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:09.399842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1274/2544] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:09.484284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:09.495392 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364aad2-85e6-4b67-b567-04e0f6708f49 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:09.501123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:09.502159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:09.502580 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:09.503041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:09.570833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:09.572330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:09.581143 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1271/2545] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:12.930596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:12.943613 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf8be-7817-4144-b7a7-437baf5b41e6 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:12.948496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194c360-442b-47ef-b215-2a7be6416f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:12.949126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c360-442b-47ef-b215-2a7be6416f0c service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:12.949405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c360-442b-47ef-b215-2a7be6416f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:12.949671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194c360-442b-47ef-b215-2a7be6416f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:13.016712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194c360-442b-47ef-b215-2a7be6416f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:13.018582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194c360-442b-47ef-b215-2a7be6416f0c service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:13.032956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1275/2546] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:13.818403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:13.883657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c465d-dc7e-4d1a-a196-ed20e7f5f7cb service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:13.890098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:13.891108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:13.891477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:13.891884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] PATH_INFO: `/v3/users/001f469d426e4639bd674ab41cc6422e` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:13.893782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001f469d426e4639bd674ab41cc6422e)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:13.897133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:13.913388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:13.957302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001f469d426e4639bd674ab41cc6422e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:13.957947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001f469d426e4639bd674ab41cc6422e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:13.958543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001f469d426e4639bd674ab41cc6422e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:13.968047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001f469d426e4639bd674ab41cc6422e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:13.975127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001f469d426e4639bd674ab41cc6422e'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:13.993331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1272/2547] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:13 2022] DELETE /identity/v3/users/001f469d426e4639bd674ab41cc6422e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:13.999676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:14.000203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:14.000203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:14.026670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:14.027990 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:14.056031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:14.102140 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1276/2548] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:14.112717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:14.115303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:14.179847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b01e9-4aba-40e6-bce8-fa8a0e2afc35 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:14.183814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:14.184423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:14.184705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:14.184972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:14.195257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:14.196736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:14.207348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1273/2549] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:14.514571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:14.516487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:14.531928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427049e6-64e3-4429-8588-8bed5248ab94 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:14.538061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:14.538826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:14.539143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:14.539420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] PATH_INFO: `/v3/projects/ef4ebb0f918248bea1a0cfa5aa5af708` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:14.540746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4ebb0f918248bea1a0cfa5aa5af708)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:14.542875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:14.598234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4ebb0f918248bea1a0cfa5aa5af708', 'request_id': 'req-5b62d960-d55d-424a-86ea-f9325caa03fa'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.604722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4ebb0f918248bea1a0cfa5aa5af708', 'request_id': 'req-5b62d960-d55d-424a-86ea-f9325caa03fa'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.611368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4ebb0f918248bea1a0cfa5aa5af708', 'request_id': 'req-5b62d960-d55d-424a-86ea-f9325caa03fa'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.631716 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] The token cache is being invalidate because project ef4ebb0f918248bea1a0cfa5aa5af708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:14.632130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.632789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.634377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1277/2550] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:14 2022] DELETE /identity/v3/projects/ef4ebb0f918248bea1a0cfa5aa5af708 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:14.639481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:14.654399 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc5f5-2f9d-48ac-b70b-4b6167f33741 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:14.727014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:14.727732 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:14.728010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:14.728283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] PATH_INFO: `/v3/users/b1185ae6f9564512aec16e41903b1367` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:14.729397 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1185ae6f9564512aec16e41903b1367)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:14.731478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:14.769075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:14.782988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1185ae6f9564512aec16e41903b1367'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.783768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1185ae6f9564512aec16e41903b1367'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.784675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1185ae6f9564512aec16e41903b1367'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.793505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1185ae6f9564512aec16e41903b1367'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.800858 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-c5e05480-69f6-49e2-b160-9358f42fe20f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1185ae6f9564512aec16e41903b1367'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:14.820440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1274/2551] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:14 2022] DELETE /identity/v3/users/b1185ae6f9564512aec16e41903b1367 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:15.130856 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.132946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:15.146887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d960-d55d-424a-86ea-f9325caa03fa admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.213394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.242727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.242727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.242727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] PATH_INFO: `/v3/projects/9550fc6266d7486fbb5ec752377e2527` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.242727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9550fc6266d7486fbb5ec752377e2527)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.242727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.279070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9550fc6266d7486fbb5ec752377e2527', 'request_id': 'req-dcb9beae-e724-4ba3-88d0-09dec4253331'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:15.284221 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:15.285859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9550fc6266d7486fbb5ec752377e2527', 'request_id': 'req-dcb9beae-e724-4ba3-88d0-09dec4253331'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:15.293975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9550fc6266d7486fbb5ec752377e2527', 'request_id': 'req-dcb9beae-e724-4ba3-88d0-09dec4253331'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:15.308610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] The token cache is being invalidate because project 9550fc6266d7486fbb5ec752377e2527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:15.308945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:15.309626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-dcb9beae-e724-4ba3-88d0-09dec4253331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:15.311701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1278/2552] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:15 2022] DELETE /identity/v3/projects/9550fc6266d7486fbb5ec752377e2527 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:15.319526 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.320135 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.320412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.342195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:15.343454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:15.420807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1275/2553] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:15.428958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.429325 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.429606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.452114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:15.453382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:15.463155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1279/2554] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:15.467664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.478264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d28619-eb04-4b29-b322-77d0381eb550 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.483542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.484150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.484433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.484704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.485369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:15.485679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.487345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.499493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1276/2555] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:15.505930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.516128 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0f21b-935e-4d72-996e-3ad7e0fa0315 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.522492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.523155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.523441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.523717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.524344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.526322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.560434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1280/2556] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:15 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:15.566821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.583357 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834cfd1-cd49-4630-bd31-c7b6cfe485f7 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.644277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.644912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.645195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.645476 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.646106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.648117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.670282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1277/2557] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:15 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:15.674683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.685892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3353d0-ac90-425a-bcb3-bc1910745a1f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.690534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.691287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.691572 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.691847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.692520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.694324 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.705441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1281/2558] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:15.710133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.724409 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d34f7-b644-4452-90ec-8090561ac560 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.733264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de217d-cda5-47da-83cd-e29f3f9e35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.734178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de217d-cda5-47da-83cd-e29f3f9e35cb admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.734462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de217d-cda5-47da-83cd-e29f3f9e35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.734847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de217d-cda5-47da-83cd-e29f3f9e35cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.736039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de217d-cda5-47da-83cd-e29f3f9e35cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.741394 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de217d-cda5-47da-83cd-e29f3f9e35cb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.758084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1278/2559] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:15.762847 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:15.774134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b36896-c75e-4ffb-a4b9-0031ce6c4883 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:15.779432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:15.780214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.780505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.780801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] PATH_INFO: `/v3/projects/070b0d1564c44ef49d53b1c8d516ee63/users/b03b6d9647a64a68ae1065598835eea9/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.799614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=070b0d1564c44ef49d53b1c8d516ee63, user_id=b03b6d9647a64a68ae1065598835eea9, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:15.802392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:15.818962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1282/2560] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:15 2022] PUT /identity/v3/projects/070b0d1564c44ef49d53b1c8d516ee63/users/b03b6d9647a64a68ae1065598835eea9/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:15.830244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:15.830822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:15.830822 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:15.860278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] MFA Rules not processed for user `b03b6d9647a64a68ae1065598835eea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:15.861483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:15.865664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:15.927359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1279/2561] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:15.932401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.001260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a56479-5bb1-44ca-b93e-565b5563b75d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.006873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.007673 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.008004 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.008320 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.009053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.011243 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.044786 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1283/2562] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:15 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:16.050569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.065649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd0d5-cbd5-4958-8c80-f708bb97f858 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.135579 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.136214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.136493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.136750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.137379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.139417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.169597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1280/2563] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:16 2022] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:16.174529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.186722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80554cc-68b9-41c1-8b1c-9dfa527d635f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.192754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.193554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.193887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.194469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.195571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.197252 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.209001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1284/2564] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:16.214004 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.224435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a1a62-4346-4c89-8008-ee2cbb9cf3ab admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.229863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.230527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.230813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.231139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] PATH_INFO: `/v3/projects/1bab2bb141e24712a82badab09721a6b/users/7ba85f6a79244289bae56dc22d857836/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.249682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bab2bb141e24712a82badab09721a6b, user_id=7ba85f6a79244289bae56dc22d857836, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.253655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.270328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1281/2565] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:16 2022] PUT /identity/v3/projects/1bab2bb141e24712a82badab09721a6b/users/7ba85f6a79244289bae56dc22d857836/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:16.276009 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.288001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1c8d4-d2d1-434c-b2b8-6dc95ce197cf admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.355236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:16.364741 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23ba2-9c43-4c45-9888-b75eac5f7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.365488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23ba2-9c43-4c45-9888-b75eac5f7619 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.366134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23ba2-9c43-4c45-9888-b75eac5f7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.366464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23ba2-9c43-4c45-9888-b75eac5f7619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.367225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e23ba2-9c43-4c45-9888-b75eac5f7619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.369033 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e23ba2-9c43-4c45-9888-b75eac5f7619 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.379915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1285/2566] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:16.384595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.395595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763aa8d-140d-428a-8bf6-06687b08d4c9 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.401916 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.402607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.402884 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.403201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] PATH_INFO: `/v3/projects/1bab2bb141e24712a82badab09721a6b/users/7ba85f6a79244289bae56dc22d857836/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.405391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bab2bb141e24712a82badab09721a6b, user_id=7ba85f6a79244289bae56dc22d857836, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.408115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.420463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1282/2567] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:16 2022] PUT /identity/v3/projects/1bab2bb141e24712a82badab09721a6b/users/7ba85f6a79244289bae56dc22d857836/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:16.432482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.432791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.433067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.464701 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] MFA Rules not processed for user `7ba85f6a79244289bae56dc22d857836`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:16.466040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:16.559685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1286/2568] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:16.576461 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.578616 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:16.642248 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca88c9-7c03-4dcd-9312-2d6384322917 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.646423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a70a7-df36-4d15-b0de-a593251e80b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.647034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a70a7-df36-4d15-b0de-a593251e80b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.647449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a70a7-df36-4d15-b0de-a593251e80b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.647747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a70a7-df36-4d15-b0de-a593251e80b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.657940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a70a7-df36-4d15-b0de-a593251e80b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.659454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a70a7-df36-4d15-b0de-a593251e80b5 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.665156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:16.670438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1283/2569] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:16.815976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:16.887178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce929abd-f016-4526-abe2-2e886c53a761 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:16.892225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:16.892952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:16.893266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:16.893556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] PATH_INFO: `/v3/users/b03b6d9647a64a68ae1065598835eea9` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:16.894911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03b6d9647a64a68ae1065598835eea9)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:16.896992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:16.952548 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03b6d9647a64a68ae1065598835eea9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:16.953253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03b6d9647a64a68ae1065598835eea9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:16.961534 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03b6d9647a64a68ae1065598835eea9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:16.962695 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03b6d9647a64a68ae1065598835eea9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:16.969989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03b6d9647a64a68ae1065598835eea9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:16.982559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:16.992706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1287/2570] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:16 2022] DELETE /identity/v3/users/b03b6d9647a64a68ae1065598835eea9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:17.002640 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:17.003222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:17.003222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:17.024346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:17.025595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:17.092797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1284/2571] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:17.103185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:17.104760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:17.166333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c51473-d6aa-4333-82cd-86be13f0c77f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:17.170877 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:17.171719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:17.171939 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:17.172258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:17.182345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:17.183822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:17.193509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1288/2572] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:17.500031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:17.501720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:17.515402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16e34-3177-4210-baf4-bc7b38d50b2a None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:17.520947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:17.521597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:17.521901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:17.522449 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] PATH_INFO: `/v3/projects/070b0d1564c44ef49d53b1c8d516ee63` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:17.523795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=070b0d1564c44ef49d53b1c8d516ee63)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:17.525901 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:17.584603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070b0d1564c44ef49d53b1c8d516ee63', 'request_id': 'req-1dfcdb15-03ee-47e0-992c-86efb41f49ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.591542 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070b0d1564c44ef49d53b1c8d516ee63', 'request_id': 'req-1dfcdb15-03ee-47e0-992c-86efb41f49ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.597319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070b0d1564c44ef49d53b1c8d516ee63', 'request_id': 'req-1dfcdb15-03ee-47e0-992c-86efb41f49ed'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.610557 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] The token cache is being invalidate because project 070b0d1564c44ef49d53b1c8d516ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:17.610849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.611500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.613030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1285/2573] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:17 2022] DELETE /identity/v3/projects/070b0d1564c44ef49d53b1c8d516ee63 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:17.617220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:17.627551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2679-b8f7-43c1-abe3-29f0aa401fa4 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:17.685003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:17.685632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:17.685908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:17.686175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] PATH_INFO: `/v3/users/7ba85f6a79244289bae56dc22d857836` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:17.687316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba85f6a79244289bae56dc22d857836)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:17.689264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:17.755477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba85f6a79244289bae56dc22d857836'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.756180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba85f6a79244289bae56dc22d857836'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.764377 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba85f6a79244289bae56dc22d857836'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.765067 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba85f6a79244289bae56dc22d857836'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.775398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba85f6a79244289bae56dc22d857836'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:17.794359 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1289/2574] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:17 2022] DELETE /identity/v3/users/7ba85f6a79244289bae56dc22d857836 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:18.038538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.041310 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.054679 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcdb15-03ee-47e0-992c-86efb41f49ed admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.093290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.094807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.123199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:18.125175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.126164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.126415 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.126636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] PATH_INFO: `/v3/users/3eb4c8f45829436a9808bb87d0a84084` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.127824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb4c8f45829436a9808bb87d0a84084)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.129776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.162691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:18.178660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c767ae-e1bb-4758-a257-089baee8a796 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.184619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.185304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.185574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.185850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] PATH_INFO: `/v3/projects/1bab2bb141e24712a82badab09721a6b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.186991 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bab2bb141e24712a82badab09721a6b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.187596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb4c8f45829436a9808bb87d0a84084'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.188261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb4c8f45829436a9808bb87d0a84084'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.188853 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb4c8f45829436a9808bb87d0a84084'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.189015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.197501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb4c8f45829436a9808bb87d0a84084'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.209906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-097b5801-1ec4-43bd-9cc8-0a3946b3333c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb4c8f45829436a9808bb87d0a84084'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.230751 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1286/2575] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:18 2022] DELETE /identity/v3/users/3eb4c8f45829436a9808bb87d0a84084 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:18.235262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.235545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.235815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.242114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bab2bb141e24712a82badab09721a6b', 'request_id': 'req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.248544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bab2bb141e24712a82badab09721a6b', 'request_id': 'req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.255422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bab2bb141e24712a82badab09721a6b', 'request_id': 'req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.256811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:18.258279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.269570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] The token cache is being invalidate because project 1bab2bb141e24712a82badab09721a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:18.269936 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.270620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7b3db870-59a5-4c68-b9b0-c79c5b87a4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.272436 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1290/2576] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:18 2022] DELETE /identity/v3/projects/1bab2bb141e24712a82badab09721a6b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:18.277201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af3c4-92be-426c-9dd5-8156b9b61956 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.277492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af3c4-92be-426c-9dd5-8156b9b61956 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.277773 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af3c4-92be-426c-9dd5-8156b9b61956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.297461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-838af3c4-92be-426c-9dd5-8156b9b61956 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:18.298710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-838af3c4-92be-426c-9dd5-8156b9b61956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.325513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1287/2577] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:18.336237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.338628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.366520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1291/2578] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:18.375186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.375495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.375772 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.397459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5391-8347-47a8-a4bc-0df0ca2c2c0e None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.398196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:18.399693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.401509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.402142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.402423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.402693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.408045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1292/2579] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:18.412528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.412676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.414040 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.422018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36b38-c192-4f9a-a4b7-58c7afbda87b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.424609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1288/2580] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:18.427195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.427805 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.428092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.428366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.429024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:18.429330 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.431080 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.444247 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1293/2581] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:07:18.449585 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.462092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63b87d-eb94-407c-8ce4-4ed50e5ee920 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.468110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.468758 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.469010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.469301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.469962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.471939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.504388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1289/2582] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/projects => generated 407 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:18.509029 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.520235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c23e8-3546-4d8d-9095-06821648f1b5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.548425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:18.584421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.585244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.585583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.585964 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.586671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.589002 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.614017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1294/2583] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/users => generated 304 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:18.618407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.629335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244afb6-184d-45c8-8487-af2423237993 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.634265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.634909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.635222 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.635495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.636178 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.637797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.648583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1290/2584] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:18.653502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.663746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeebf58-978f-4e05-bb1a-141703aadc7c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.668636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.669182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.669459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.669733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.670375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.672040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.683397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1295/2585] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:18.687667 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.698195 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8ce2-b67a-4f75-9c56-6229836c42cf admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.702979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ae907-d069-405f-ae76-5fe47e324261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.703655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae907-d069-405f-ae76-5fe47e324261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.704255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae907-d069-405f-ae76-5fe47e324261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.704255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae907-d069-405f-ae76-5fe47e324261 admin admin] PATH_INFO: `/v3/projects/e6c719e9d1fa41bb8ddfac9d0b3d294c/users/30f3ad6e7902472993b2a60697fbcb4f/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.719225 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.721425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.722676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:18.730047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ae907-d069-405f-ae76-5fe47e324261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c719e9d1fa41bb8ddfac9d0b3d294c, user_id=30f3ad6e7902472993b2a60697fbcb4f, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.734150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ae907-d069-405f-ae76-5fe47e324261 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.750357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632066ac-a533-4513-94ec-0fe5b34c41a9 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.754727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1291/2586] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:18 2022] PUT /identity/v3/projects/e6c719e9d1fa41bb8ddfac9d0b3d294c/users/30f3ad6e7902472993b2a60697fbcb4f/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:18.764864 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.765153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.765441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.794091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] MFA Rules not processed for user `30f3ad6e7902472993b2a60697fbcb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:18.795452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.812355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.812976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.813506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.813844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] PATH_INFO: `/v3/projects/23f6a83dd2904b3b8b849b8c2cc31312` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.815074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f6a83dd2904b3b8b849b8c2cc31312)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.817044 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.865410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f6a83dd2904b3b8b849b8c2cc31312', 'request_id': 'req-f341106b-1290-4124-a8b3-32537a1de14c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.865775 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1292/2587] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:18.870990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.875865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f6a83dd2904b3b8b849b8c2cc31312', 'request_id': 'req-f341106b-1290-4124-a8b3-32537a1de14c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.882638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f6a83dd2904b3b8b849b8c2cc31312', 'request_id': 'req-f341106b-1290-4124-a8b3-32537a1de14c'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.886728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc20a9-44be-42a6-adce-f7d02f5a9f35 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.896288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] The token cache is being invalidate because project 23f6a83dd2904b3b8b849b8c2cc31312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:18.896586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.897272 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:18.899230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1296/2588] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:18 2022] DELETE /identity/v3/projects/23f6a83dd2904b3b8b849b8c2cc31312 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:18.903434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.905166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:18.947012 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:18.950812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.951465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.951725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.952027 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.952674 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.954584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.973605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341106b-1290-4124-a8b3-32537a1de14c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:18.978988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:18.979693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:18.979981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:18.980258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] PATH_INFO: `/v3/users/6584d34689664c859d80f10f868d304b` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:18.981432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6584d34689664c859d80f10f868d304b)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:18.982547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1293/2589] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:18.983452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:18.986643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:18.988646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.034866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6584d34689664c859d80f10f868d304b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.035795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6584d34689664c859d80f10f868d304b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.044046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6584d34689664c859d80f10f868d304b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.044900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6584d34689664c859d80f10f868d304b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.052880 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6584d34689664c859d80f10f868d304b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.056255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a264d7-dca5-4438-86ea-2a9597d25979 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.060944 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.061540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.061820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.062082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.062747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.064709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.074950 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1297/2590] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:18 2022] DELETE /identity/v3/users/6584d34689664c859d80f10f868d304b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:19.075529 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:19.090477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1294/2591] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:18 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:19.094253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.095827 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.165464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9664cc9-872c-4fa7-8407-cd35ac4865ba admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.170358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.170968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.171279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.171547 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.172190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.174193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.186554 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1298/2592] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:19.191709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.203262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e22d8-d7e3-4809-b5d3-a3586fec7415 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.209460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.210157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.210443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.211460 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] PATH_INFO: `/v3/projects/42d6b0dc57a54e84b5446ab8e40187fb/users/24be607a72164415bd87dbe3d58aa295/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.228179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d6b0dc57a54e84b5446ab8e40187fb, user_id=24be607a72164415bd87dbe3d58aa295, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.230898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.247153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1295/2593] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:19 2022] PUT /identity/v3/projects/42d6b0dc57a54e84b5446ab8e40187fb/users/24be607a72164415bd87dbe3d58aa295/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:19.251074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.262379 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06652d86-97e3-4986-b52c-4a5eb3b88d81 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.321583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:19.332932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.333551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.333834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.334106 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.334763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.336623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.347219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1299/2594] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:19.353011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.366427 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e638-8f53-40c5-be48-db8f925061ad admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.373035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.374917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.376128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3117f-3f4b-43d6-9af0-9f8ad4251ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.376831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3117f-3f4b-43d6-9af0-9f8ad4251ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.377131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3117f-3f4b-43d6-9af0-9f8ad4251ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.377428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3117f-3f4b-43d6-9af0-9f8ad4251ba5 admin admin] PATH_INFO: `/v3/projects/42d6b0dc57a54e84b5446ab8e40187fb/users/24be607a72164415bd87dbe3d58aa295/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.381127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3117f-3f4b-43d6-9af0-9f8ad4251ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d6b0dc57a54e84b5446ab8e40187fb, user_id=24be607a72164415bd87dbe3d58aa295, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.386817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3117f-3f4b-43d6-9af0-9f8ad4251ba5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.393351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f504d-d7c1-446b-a743-7eae27fd7587 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.402621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.402782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1296/2595] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:19 2022] PUT /identity/v3/projects/42d6b0dc57a54e84b5446ab8e40187fb/users/24be607a72164415bd87dbe3d58aa295/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:19.407700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.408561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.408913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] PATH_INFO: `/v3/projects/59e01fedb46e4a708e25a73fdbb305fe` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.410255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e01fedb46e4a708e25a73fdbb305fe)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.412369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.415551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.415838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.416109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.446755 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] MFA Rules not processed for user `24be607a72164415bd87dbe3d58aa295`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:19.448731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.469055 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e01fedb46e4a708e25a73fdbb305fe', 'request_id': 'req-fa26a930-625a-4d16-89ea-bf9098146705'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.474601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e01fedb46e4a708e25a73fdbb305fe', 'request_id': 'req-fa26a930-625a-4d16-89ea-bf9098146705'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.481764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e01fedb46e4a708e25a73fdbb305fe', 'request_id': 'req-fa26a930-625a-4d16-89ea-bf9098146705'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.503503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] The token cache is being invalidate because project 59e01fedb46e4a708e25a73fdbb305fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:19.504091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.504975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fa26a930-625a-4d16-89ea-bf9098146705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:19.506521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1300/2596] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:19 2022] DELETE /identity/v3/projects/59e01fedb46e4a708e25a73fdbb305fe => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:19.513797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0cd4f-8136-4fe4-bbaf-61ea30c8db09 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.514104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0cd4f-8136-4fe4-bbaf-61ea30c8db09 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.514378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0cd4f-8136-4fe4-bbaf-61ea30c8db09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.528537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1297/2597] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:19.534857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-c4c0cd4f-8136-4fe4-bbaf-61ea30c8db09 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:19.536108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c4c0cd4f-8136-4fe4-bbaf-61ea30c8db09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.539990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.541325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.599217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211821-a2a4-4d03-b1a1-8618d94e4ad9 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.602931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1301/2598] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:19.611504 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.611790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.612167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.631528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:19.632721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:19.641273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1302/2599] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:19.645519 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.651760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.652416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.652748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.653018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.655271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e28417-3cad-4a49-8410-49e621ca83e8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.660731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.661338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.661614 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.661881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.662337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:19.662564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:19.662866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.664963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.677917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1303/2600] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:07:19.682749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.692566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288de55-ad55-4244-b7ac-e4ebe8654b26 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.697926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.698531 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.698813 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.699126 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.699746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.701705 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.717714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.719539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.730825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1298/2601] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:19.736031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1304/2602] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:19 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:19.736924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.747728 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052e75-bf10-4ff5-aa85-aa4b1691ba41 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.810275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.810275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.810604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.810789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.811425 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.813348 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.836148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1299/2603] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:19 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:19.841407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.852643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16070553-ce64-4d8b-bd55-072a821536f9 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.858186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.858810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.859208 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.859487 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.860133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.861738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.873177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1305/2604] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:19.877288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.887963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9114dda-2ea5-4aee-b7b5-336263d8a35b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.892837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.893430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.893731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.893983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.894677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.896332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.899535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.910709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1300/2605] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:19.912002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:19.922175 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f3e1-4608-4e16-9a1f-ac423e2c58db admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.923461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:19.927186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc5e9f-aa8d-4c35-a086-937abc7dc4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:19.927846 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5e9f-aa8d-4c35-a086-937abc7dc4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.928354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5e9f-aa8d-4c35-a086-937abc7dc4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.928492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc5e9f-aa8d-4c35-a086-937abc7dc4e2 admin admin] PATH_INFO: `/v3/projects/b4b53d64aa7e442e845d47c31e0e2a6d/users/4a7b800e16d34040ac4eb41a6b9702c1/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:19.945075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5e9f-aa8d-4c35-a086-937abc7dc4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b53d64aa7e442e845d47c31e0e2a6d, user_id=4a7b800e16d34040ac4eb41a6b9702c1, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:19.948455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc5e9f-aa8d-4c35-a086-937abc7dc4e2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:19.964349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1301/2606] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:19 2022] PUT /identity/v3/projects/b4b53d64aa7e442e845d47c31e0e2a6d/users/4a7b800e16d34040ac4eb41a6b9702c1/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:19.965038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d5c8-41d3-4e20-ba95-e435266ede62 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:19.977540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:19.977764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:19.978077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:20.008158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] MFA Rules not processed for user `4a7b800e16d34040ac4eb41a6b9702c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:20.009456 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:20.016792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:20.017413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:20.017691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:20.017965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:20.019966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:20.060145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:20.080285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1302/2607] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:20.084462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:20.088928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e395b3-2bec-40fe-a908-40ff97f551ae service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:20.092919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:20.094893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:20.098299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1306/2608] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:19 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:20.108256 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed3003-226e-4fe4-9b0e-a61837521910 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:20.112776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:20.113466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:20.113756 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:20.114165 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:20.123655 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:20.125205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:20.134888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1303/2609] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:21.529018 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca609a-8f87-4f4e-b435-8cd3a4965a7f None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:21.529841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca609a-8f87-4f4e-b435-8cd3a4965a7f None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:21.530281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca609a-8f87-4f4e-b435-8cd3a4965a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:21.553287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-9eca609a-8f87-4f4e-b435-8cd3a4965a7f None None] MFA Rules not processed for user `4a7b800e16d34040ac4eb41a6b9702c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:21.554804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9eca609a-8f87-4f4e-b435-8cd3a4965a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:21.564342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1307/2610] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:25.536644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:25.538306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:25.612008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d61551-09f3-4a05-b6ee-bfe369836430 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:25.616861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:25.617654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:25.618032 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:25.618291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] PATH_INFO: `/v3/users/30f3ad6e7902472993b2a60697fbcb4f` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:25.619467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f3ad6e7902472993b2a60697fbcb4f)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:25.621414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:25.677784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f3ad6e7902472993b2a60697fbcb4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:25.678467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f3ad6e7902472993b2a60697fbcb4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:25.679238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f3ad6e7902472993b2a60697fbcb4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:25.687823 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f3ad6e7902472993b2a60697fbcb4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:25.695744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f3ad6e7902472993b2a60697fbcb4f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:25.714792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1304/2611] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:25 2022] DELETE /identity/v3/users/30f3ad6e7902472993b2a60697fbcb4f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:25.719265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:25.719756 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:25.720053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:25.739638 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:25.740958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:25.803469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1308/2612] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:25.818693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:25.821734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:25.898761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9220-03c6-47ce-aab1-f37d5ca2f853 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:25.903072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:25.903713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:25.903949 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:25.904240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:25.914221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:25.915670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:25.920598 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:25.925852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1305/2613] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:26.210739 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:26.212485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:26.225723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361c68a-9fc1-41b0-9785-0df88b69fa03 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:26.231715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:26.232362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:26.232637 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:26.232899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] PATH_INFO: `/v3/projects/e6c719e9d1fa41bb8ddfac9d0b3d294c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:26.234065 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c719e9d1fa41bb8ddfac9d0b3d294c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:26.236101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:26.260455 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:26.285740 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c719e9d1fa41bb8ddfac9d0b3d294c', 'request_id': 'req-02b6ec2c-b163-42b8-8545-79c3de608104'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.292270 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c719e9d1fa41bb8ddfac9d0b3d294c', 'request_id': 'req-02b6ec2c-b163-42b8-8545-79c3de608104'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.298902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c719e9d1fa41bb8ddfac9d0b3d294c', 'request_id': 'req-02b6ec2c-b163-42b8-8545-79c3de608104'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.315958 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] The token cache is being invalidate because project e6c719e9d1fa41bb8ddfac9d0b3d294c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:26.316401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.317156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.318976 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1309/2614] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:26 2022] DELETE /identity/v3/projects/e6c719e9d1fa41bb8ddfac9d0b3d294c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:26.324538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:26.334700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d66da-5c65-4912-a8c4-382e0fe99c6a service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:26.394528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:26.395241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:26.395527 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:26.395800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] PATH_INFO: `/v3/users/24be607a72164415bd87dbe3d58aa295` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:26.397006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24be607a72164415bd87dbe3d58aa295)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:26.399101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:26.448990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24be607a72164415bd87dbe3d58aa295'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.449689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24be607a72164415bd87dbe3d58aa295'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.450291 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24be607a72164415bd87dbe3d58aa295'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.458563 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24be607a72164415bd87dbe3d58aa295'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.466217 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-50be7df5-fb8d-4b24-8435-9212945181f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24be607a72164415bd87dbe3d58aa295'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.486604 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1306/2615] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:26 2022] DELETE /identity/v3/users/24be607a72164415bd87dbe3d58aa295 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:26.801874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:26.803776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:26.828687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ec2c-b163-42b8-8545-79c3de608104 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:26.907934 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:26.908758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:26.909040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:26.909334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] PATH_INFO: `/v3/projects/42d6b0dc57a54e84b5446ab8e40187fb` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:26.910612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d6b0dc57a54e84b5446ab8e40187fb)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:26.913230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:26.971369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d6b0dc57a54e84b5446ab8e40187fb', 'request_id': 'req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.978327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d6b0dc57a54e84b5446ab8e40187fb', 'request_id': 'req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:26.986087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d6b0dc57a54e84b5446ab8e40187fb', 'request_id': 'req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:27.002063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] The token cache is being invalidate because project 42d6b0dc57a54e84b5446ab8e40187fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:27.002488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:27.003142 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-8ed4dbf4-f49d-4d10-b189-bc0d826bfcbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:27.004896 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1310/2616] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:26 2022] DELETE /identity/v3/projects/42d6b0dc57a54e84b5446ab8e40187fb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:27.010069 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.010578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.010704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.030126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:27.031385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:27.099831 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1307/2617] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:27.107759 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.108052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.108342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.131020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:27.132584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:27.141307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1311/2618] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:27.145622 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.156813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a864b7-42b0-4f71-ba49-567150ae08bb None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.162354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.162973 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.163286 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.163588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.164241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:27.164700 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.166480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.180203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1308/2619] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:27.186405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.201463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66359d6-8fc4-42af-ad9d-5af998d8132c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.207570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.208186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.208443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.208736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.209373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.211507 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.242085 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1312/2620] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:27.246601 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.256886 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaa6b4-ba54-4e0d-9cba-f4941b7c1eab admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.261255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:27.322983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.323668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.323960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.324241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.324878 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.326857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.351264 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1309/2621] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:27.358693 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.373199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1cbc6-8cb4-4a7c-b917-49b068006bd1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.378553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.379179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.379459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.379732 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.380392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.382189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.384782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:27.394899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1313/2622] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:27.399117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.409798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc544357-704d-40d4-ae77-aaafa57e5f0d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.414538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c961f-9c9e-4cac-a136-26ba0ac91aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.415173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c961f-9c9e-4cac-a136-26ba0ac91aed admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.415457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c961f-9c9e-4cac-a136-26ba0ac91aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.415727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c961f-9c9e-4cac-a136-26ba0ac91aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.416386 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c961f-9c9e-4cac-a136-26ba0ac91aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.417988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c961f-9c9e-4cac-a136-26ba0ac91aed admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.429058 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1310/2623] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:27.433919 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.445003 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38adffd-00cb-40fe-b435-7aa46833baeb admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.451327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.451962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.452234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.452499 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] PATH_INFO: `/v3/projects/0d7c55704b90411eaa721d37ab9da7fb/users/281a1f2e085f41e4ae46ea8b25258273/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.468642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7c55704b90411eaa721d37ab9da7fb, user_id=281a1f2e085f41e4ae46ea8b25258273, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.471382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.485312 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1314/2624] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:27 2022] PUT /identity/v3/projects/0d7c55704b90411eaa721d37ab9da7fb/users/281a1f2e085f41e4ae46ea8b25258273/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:27.497376 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.497554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.497852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.528056 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] MFA Rules not processed for user `281a1f2e085f41e4ae46ea8b25258273`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:27.529290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:27.598909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1311/2625] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:27.603643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.665924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7b06b-b6e8-475a-8ff6-a79e334b029f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.672137 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.672446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.672727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.672992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.673618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.675579 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.712019 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1315/2626] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:27.718395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.729654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de241-716d-4a88-84ed-a6aa2109ae50 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.793358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.793887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.794163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.794429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.795071 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.797003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.820241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1312/2627] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:27 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:27.824649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.835523 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d86fe1-cb44-4caa-b6a4-33ccc02e6b71 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.841619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.842263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.842539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.842808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.843509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.845129 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.857955 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1316/2628] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:27.863013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.870513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:27.874440 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61f5dd-7c05-4cf1-a5f1-4f4d461d02c5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:27.880396 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:27.881362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:27.881891 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:27.882287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] PATH_INFO: `/v3/projects/efe7a1578b334554ae7ed3bed999ebc6/users/167d0aaeac324aafb17c5283e037209d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:27.902139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe7a1578b334554ae7ed3bed999ebc6, user_id=167d0aaeac324aafb17c5283e037209d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:27.905150 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:27.919482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1313/2629] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:27 2022] PUT /identity/v3/projects/efe7a1578b334554ae7ed3bed999ebc6/users/167d0aaeac324aafb17c5283e037209d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:27.923801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:27.935258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48728713-7d5c-4f41-b5f7-66600afa6855 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:28.000833 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7fb5b-fcee-44e1-b6b0-de08f8596f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:28.001722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7fb5b-fcee-44e1-b6b0-de08f8596f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:28.001722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7fb5b-fcee-44e1-b6b0-de08f8596f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:28.002051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7fb5b-fcee-44e1-b6b0-de08f8596f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:28.002661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7fb5b-fcee-44e1-b6b0-de08f8596f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:28.004275 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7fb5b-fcee-44e1-b6b0-de08f8596f26 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:28.015771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1317/2630] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:28.019925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:28.031941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec49c1d-2ac4-4303-b244-0868fdc2a2c5 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:28.037243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:28.038518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:28.039363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:28.039648 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] PATH_INFO: `/v3/projects/efe7a1578b334554ae7ed3bed999ebc6/users/167d0aaeac324aafb17c5283e037209d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:28.042964 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe7a1578b334554ae7ed3bed999ebc6, user_id=167d0aaeac324aafb17c5283e037209d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:28.046160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:28.059773 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1314/2631] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:28 2022] PUT /identity/v3/projects/efe7a1578b334554ae7ed3bed999ebc6/users/167d0aaeac324aafb17c5283e037209d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:28.071167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:28.071457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:28.071733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:28.105661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] MFA Rules not processed for user `167d0aaeac324aafb17c5283e037209d`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:28.106909 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:28.149263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:28.187903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1318/2632] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:28.200346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:28.202258 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:28.262702 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6eecda-d7ac-4a48-a201-ff75508a9bee admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:28.267325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:28.267932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:28.268210 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:28.268475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:28.278389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:28.279859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:28.289302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1315/2633] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:28.388651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:28.399743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1567c-bead-4c0e-8524-1de0369e211b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:28.404041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ccf7-5ee4-4004-855f-40f755a34d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:28.404647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ccf7-5ee4-4004-855f-40f755a34d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:28.404920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ccf7-5ee4-4004-855f-40f755a34d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:28.405186 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ccf7-5ee4-4004-855f-40f755a34d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:28.465515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ccf7-5ee4-4004-855f-40f755a34d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:28.467021 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ccf7-5ee4-4004-855f-40f755a34d70 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:28.476184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1319/2634] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:33.472748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:33.538446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3297206-4ccf-4b15-8e60-beb5cf01ce6a service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:33.544201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:33.544837 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:33.545112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:33.545379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] PATH_INFO: `/v3/users/281a1f2e085f41e4ae46ea8b25258273` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:33.546668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281a1f2e085f41e4ae46ea8b25258273)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:33.548683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:33.604003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281a1f2e085f41e4ae46ea8b25258273'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:33.604647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281a1f2e085f41e4ae46ea8b25258273'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:33.605243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281a1f2e085f41e4ae46ea8b25258273'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:33.612684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281a1f2e085f41e4ae46ea8b25258273'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:33.620054 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281a1f2e085f41e4ae46ea8b25258273'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:33.627024 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:33.639810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1316/2635] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:33 2022] DELETE /identity/v3/users/281a1f2e085f41e4ae46ea8b25258273 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:33.644326 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:33.644792 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:33.644924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:33.668404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:33.670332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:33.738750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1320/2636] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:33.749137 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:33.750747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:33.812942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633276e-5aba-48f3-912b-7268b2c9b1b3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:33.817349 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:33.817971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:33.818257 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:33.818536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:33.829136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:33.830836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:33.841391 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1317/2637] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:34.133815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:34.135619 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:34.149617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc46f0-2cb5-42db-b23d-744be1653b92 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:34.155060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:34.156444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:34.156444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:34.156444 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] PATH_INFO: `/v3/projects/0d7c55704b90411eaa721d37ab9da7fb` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:34.157757 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7c55704b90411eaa721d37ab9da7fb)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:34.159835 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:34.221079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7c55704b90411eaa721d37ab9da7fb', 'request_id': 'req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.226901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7c55704b90411eaa721d37ab9da7fb', 'request_id': 'req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.235431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7c55704b90411eaa721d37ab9da7fb', 'request_id': 'req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.237431 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:34.250611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] The token cache is being invalidate because project 0d7c55704b90411eaa721d37ab9da7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:34.250903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.251721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.253453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1321/2638] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:34 2022] DELETE /identity/v3/projects/0d7c55704b90411eaa721d37ab9da7fb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:34.258435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:34.272666 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf0ec-269c-4b20-94fe-10e307f73547 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:34.332406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:34.332965 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:34.333243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:34.333517 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] PATH_INFO: `/v3/users/167d0aaeac324aafb17c5283e037209d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:34.334658 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167d0aaeac324aafb17c5283e037209d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:34.336676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:34.388904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167d0aaeac324aafb17c5283e037209d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.389597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167d0aaeac324aafb17c5283e037209d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.390300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167d0aaeac324aafb17c5283e037209d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.398080 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167d0aaeac324aafb17c5283e037209d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.406097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-e2c0669b-44d0-4212-97cf-8ec070a3c0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167d0aaeac324aafb17c5283e037209d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.425767 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1318/2639] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:34 2022] DELETE /identity/v3/users/167d0aaeac324aafb17c5283e037209d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:34.726566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:34.728073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:34.743397 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a039c25-7ba3-4c86-9563-bf0d123ea9dc admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:34.808170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:34.809236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:34.809522 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:34.809797 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] PATH_INFO: `/v3/projects/efe7a1578b334554ae7ed3bed999ebc6` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:34.811077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe7a1578b334554ae7ed3bed999ebc6)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:34.813024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:34.875488 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe7a1578b334554ae7ed3bed999ebc6', 'request_id': 'req-f7111c84-07fe-4273-b8f8-9c6506447210'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.880842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe7a1578b334554ae7ed3bed999ebc6', 'request_id': 'req-f7111c84-07fe-4273-b8f8-9c6506447210'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.887192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe7a1578b334554ae7ed3bed999ebc6', 'request_id': 'req-f7111c84-07fe-4273-b8f8-9c6506447210'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.901953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] The token cache is being invalidate because project efe7a1578b334554ae7ed3bed999ebc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:34.902235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.902914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f7111c84-07fe-4273-b8f8-9c6506447210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:34.904589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1322/2640] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:34 2022] DELETE /identity/v3/projects/efe7a1578b334554ae7ed3bed999ebc6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:34.909671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24450fc-5012-4164-8430-3052b5988372 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:34.910335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24450fc-5012-4164-8430-3052b5988372 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:34.910335 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24450fc-5012-4164-8430-3052b5988372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:34.931312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c24450fc-5012-4164-8430-3052b5988372 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:34.932537 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c24450fc-5012-4164-8430-3052b5988372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:34.938362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:35.003154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1319/2641] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:35.012101 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.012746 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.013244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.035576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:35.036814 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:35.045543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1323/2642] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:35.050022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24450fc-5012-4164-8430-3052b5988372 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.060509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24450fc-5012-4164-8430-3052b5988372 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.065793 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.066474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.066750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.067029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.067722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:35.068429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.069947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.083651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1320/2643] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:35.088514 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.100368 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e090f0d-839d-4af0-9c36-896afa1ca2e0 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.106484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.108047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.108047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.108047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.108598 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.110736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.145782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1324/2644] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:35 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:35.150862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.162625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8ce0f-9f1d-4a24-9a3a-764d4ca18d05 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.234447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.235118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.235413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.235693 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.236363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.238369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.267370 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1321/2645] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:35 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:35.272089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.284997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f710b-54ae-42be-a603-4ecc8d17ea7d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.290569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.291256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.291834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.292072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.292846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.294875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.307333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1325/2646] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:35.312332 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.325113 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d84a6a-555e-4d75-b804-6d20ed816e0a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.331759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ea342-11e4-4b01-8919-cb2edda5e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.332380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea342-11e4-4b01-8919-cb2edda5e1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.332662 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea342-11e4-4b01-8919-cb2edda5e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.332967 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea342-11e4-4b01-8919-cb2edda5e1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.333888 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ea342-11e4-4b01-8919-cb2edda5e1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.335814 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ea342-11e4-4b01-8919-cb2edda5e1f6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.349101 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1322/2647] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:35.354640 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.367432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173aed-88a2-4dcb-954c-06962cc06f40 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.373921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.374789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.375168 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.375511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] PATH_INFO: `/v3/projects/33842c44f4324ec8a964297e5de1d792/users/8d2e00fef0544463835203d7fccda616/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.398446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33842c44f4324ec8a964297e5de1d792, user_id=8d2e00fef0544463835203d7fccda616, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.401332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.420266 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1326/2648] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:35 2022] PUT /identity/v3/projects/33842c44f4324ec8a964297e5de1d792/users/8d2e00fef0544463835203d7fccda616/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:35.434369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc7d6-3384-4888-abcd-8d4175c607bd None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.434671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc7d6-3384-4888-abcd-8d4175c607bd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.434917 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edc7d6-3384-4888-abcd-8d4175c607bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.469915 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d6edc7d6-3384-4888-abcd-8d4175c607bd None None] MFA Rules not processed for user `8d2e00fef0544463835203d7fccda616`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:35.471194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d6edc7d6-3384-4888-abcd-8d4175c607bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:35.543740 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1323/2649] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:35.555171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:35.557236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:35.583028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:35.636951 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abf59-8fe5-42ff-b0db-4c251b60dbc0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:35.641017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:35.641930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:35.642214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:35.642485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:35.652496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:35.654206 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:35.664871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1327/2650] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:37.989229 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e928f-3e50-41cf-bf87-695b8b01212d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:37.989733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e928f-3e50-41cf-bf87-695b8b01212d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:37.989829 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e928f-3e50-41cf-bf87-695b8b01212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:38.004483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:38.011802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4b7e928f-3e50-41cf-bf87-695b8b01212d None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:38.013433 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4b7e928f-3e50-41cf-bf87-695b8b01212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:38.072292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1324/2651] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:07:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:38.095553 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:38.097122 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:38.200227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d27a2b-6b20-43d0-a9dc-0e68865b4fdd service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:38.207558 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:38.208603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:38.208982 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:38.209265 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:38.219776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:38.221439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:38.231524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1328/2652] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:07:38.824289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a9f2-b6b1-4733-a576-4cfce81d2bf6 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:38.824582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a9f2-b6b1-4733-a576-4cfce81d2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:38.824872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a9f2-b6b1-4733-a576-4cfce81d2bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:38.848514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5028a9f2-b6b1-4733-a576-4cfce81d2bf6 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:38.849727 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5028a9f2-b6b1-4733-a576-4cfce81d2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:38.862406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1325/2653] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 10:07:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:38.876582 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:38.887384 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badfb1d-ae7e-4c1f-8497-ce964f75b64e service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:38.896404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:38.897239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:38.897710 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:38.897947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:38.910830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:38.913321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:38.925114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1329/2654] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:07:39.205274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6419f-c9c2-4a07-b1ab-5afcd68e6f75 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:39.206116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6419f-c9c2-4a07-b1ab-5afcd68e6f75 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:39.206546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6419f-c9c2-4a07-b1ab-5afcd68e6f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:39.230857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-c5b6419f-c9c2-4a07-b1ab-5afcd68e6f75 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:39.232211 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c5b6419f-c9c2-4a07-b1ab-5afcd68e6f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:39.240124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1326/2655] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:07:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:39.253535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:39.265576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab03c5-7691-44b3-a58d-5adedeb25efe service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:39.270862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:39.271508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:39.271791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:39.272063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:39.281492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:39.283244 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:39.292179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1330/2656] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:07:39.661875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:39.662161 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:39.662443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:39.683225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:39.684443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:39.693202 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1327/2657] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 10:07:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:39.707895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:39.719182 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bbac-b673-4f5c-bbb0-c2fcdcecc03a service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:39.725167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abbde5-30c4-4adf-8350-db3c04965303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:39.725841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abbde5-30c4-4adf-8350-db3c04965303 service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:39.726120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abbde5-30c4-4adf-8350-db3c04965303 service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:39.726391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abbde5-30c4-4adf-8350-db3c04965303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:39.735484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abbde5-30c4-4adf-8350-db3c04965303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:39.737282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abbde5-30c4-4adf-8350-db3c04965303 service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:39.746782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1331/2658] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:07:41.265978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:41.346477 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4fe5-62bc-4f80-832c-e8f64b7b2bce None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:41.351801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:41.352361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:41.352652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:41.352923 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] PATH_INFO: `/v3/users/8d2e00fef0544463835203d7fccda616` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:41.354327 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2e00fef0544463835203d7fccda616)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:41.356769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:41.419559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2e00fef0544463835203d7fccda616'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:41.420625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2e00fef0544463835203d7fccda616'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:41.421596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2e00fef0544463835203d7fccda616'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:41.433595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2e00fef0544463835203d7fccda616'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:41.444346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2e00fef0544463835203d7fccda616'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:41.465334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1328/2659] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:41 2022] DELETE /identity/v3/users/8d2e00fef0544463835203d7fccda616 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:41.470778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:41.471585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:41.471585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:41.494851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:41.496478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:41.580440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1332/2660] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:41.592463 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:41.594002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:41.614187 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:41.666991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8a76-8048-4913-b2a8-50b229d836a6 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:41.671798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:41.672441 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:41.672720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:41.672985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:41.683290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:41.684950 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:41.695971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1329/2661] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:41.990611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:41.992239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.006653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ceb01c-97e7-4027-8622-51842b085dc5 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.013394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.013975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.014233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.014503 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] PATH_INFO: `/v3/users/4a7b800e16d34040ac4eb41a6b9702c1` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.015831 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7b800e16d34040ac4eb41a6b9702c1)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.019818 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.025848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.028730 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.030633 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=100 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:42.056705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe99a4a-6a5f-4630-9301-daf969395cba service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.077899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.078577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.079081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.079364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] PATH_INFO: `/v3/projects/33842c44f4324ec8a964297e5de1d792` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.080578 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33842c44f4324ec8a964297e5de1d792)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.082532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.095649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7b800e16d34040ac4eb41a6b9702c1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.096303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7b800e16d34040ac4eb41a6b9702c1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.105360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7b800e16d34040ac4eb41a6b9702c1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.106666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7b800e16d34040ac4eb41a6b9702c1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.116894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7b800e16d34040ac4eb41a6b9702c1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.136760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1333/2662] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:41 2022] DELETE /identity/v3/users/4a7b800e16d34040ac4eb41a6b9702c1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:42.138053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.141177 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.143018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33842c44f4324ec8a964297e5de1d792', 'request_id': 'req-db3f2994-bccf-4950-95c1-f9a36e369769'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.151710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33842c44f4324ec8a964297e5de1d792', 'request_id': 'req-db3f2994-bccf-4950-95c1-f9a36e369769'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.159152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33842c44f4324ec8a964297e5de1d792', 'request_id': 'req-db3f2994-bccf-4950-95c1-f9a36e369769'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.176292 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] The token cache is being invalidate because project 33842c44f4324ec8a964297e5de1d792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:42.176868 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.177607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-db3f2994-bccf-4950-95c1-f9a36e369769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.179406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1330/2663] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:42 2022] DELETE /identity/v3/projects/33842c44f4324ec8a964297e5de1d792 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:42.181406 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78178f39-d11a-4fbc-84ee-57d8d9717f4c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.181890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78178f39-d11a-4fbc-84ee-57d8d9717f4c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.182786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78178f39-d11a-4fbc-84ee-57d8d9717f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.213578 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1ef7-ff38-46fb-9358-f2545b0e45d7 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.213685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-78178f39-d11a-4fbc-84ee-57d8d9717f4c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:42.214403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-78178f39-d11a-4fbc-84ee-57d8d9717f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.220158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.221975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.222465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.222945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.225216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.293142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1331/2664] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:42.294290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad01a8-0e45-4a88-a92c-bdda10336a1d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.294290 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad01a8-0e45-4a88-a92c-bdda10336a1d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.294613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad01a8-0e45-4a88-a92c-bdda10336a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.311290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.313020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.324995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-acad01a8-0e45-4a88-a92c-bdda10336a1d None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:42.326436 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-acad01a8-0e45-4a88-a92c-bdda10336a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.326646 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1334/2665] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:42.327630 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.329045 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.337934 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1332/2666] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:42.341768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fed366-7aed-488a-8a0c-0ee5c553d5e8 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.346829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.347104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.347299 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.347528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.347639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.348258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.348550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.363016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.364789 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.371562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:42.372821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.378567 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1335/2667] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:42.385121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1333/2668] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:42.386183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.405407 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389bcd9-a543-4acb-bd22-d9247e96a7dc service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.411893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.412570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.412848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.413245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.414689 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:42.414931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.416908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.435091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1336/2669] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:07:42.440684 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.452462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43918b5c-7abb-4528-b6fa-607b6de55cd7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.458467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.459224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.459401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.459587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.460473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.462215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.499484 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1334/2670] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:42.503959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.519233 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b98cf-8fde-4af8-9151-03637440c8f4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.523815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:42.586959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.587720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.588057 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.588399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.589187 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.591353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.616904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1337/2671] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:42.621712 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.628395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:42.633587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cd7e-2db1-4aee-b9c9-a1ada7b7d3f6 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.642014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.642678 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.642970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.643513 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.644196 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.646993 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.663624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1335/2672] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:42.668866 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.679269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059c45-c48f-427c-b9ed-487af74ddb4b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.684781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c50efd-023f-420f-838c-da5feeb70d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.685441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c50efd-023f-420f-838c-da5feeb70d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.685717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c50efd-023f-420f-838c-da5feeb70d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.685975 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c50efd-023f-420f-838c-da5feeb70d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.686627 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c50efd-023f-420f-838c-da5feeb70d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.688312 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c50efd-023f-420f-838c-da5feeb70d2d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.699865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1338/2673] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:42.704314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.714288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f56ca-65ef-4505-b705-7ecdba533ab0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.719431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.720106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.720384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.721014 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] PATH_INFO: `/v3/projects/df9ab9d4df424a6da632daea7b7c0638/users/4057f374a19042b3bfaf7fcfb4aa883d/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.738360 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9ab9d4df424a6da632daea7b7c0638, user_id=4057f374a19042b3bfaf7fcfb4aa883d, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.741442 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.761663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1336/2674] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:42 2022] PUT /identity/v3/projects/df9ab9d4df424a6da632daea7b7c0638/users/4057f374a19042b3bfaf7fcfb4aa883d/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:42.772452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.772874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.773277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.785971 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.786540 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.816083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] MFA Rules not processed for user `4057f374a19042b3bfaf7fcfb4aa883d`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:42.817452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:42.884042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9641bfd-f8be-41de-9c1a-8cf51680adc0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.890338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.891438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.892190 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.892621 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] PATH_INFO: `/v3/projects/b4b53d64aa7e442e845d47c31e0e2a6d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.893998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b53d64aa7e442e845d47c31e0e2a6d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.896127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.906421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1339/2675] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:42.908095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.919854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64b5ba-d2de-4ade-893e-f8366b4e4671 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:42.924505 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:42.925115 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:42.925399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:42.925807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:42.926442 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:42.928400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:42.961194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b53d64aa7e442e845d47c31e0e2a6d', 'request_id': 'req-700ac9c5-20f4-4461-94e3-2f9c904f6638'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.966166 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1340/2676] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:42.970293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:42.973377 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b53d64aa7e442e845d47c31e0e2a6d', 'request_id': 'req-700ac9c5-20f4-4461-94e3-2f9c904f6638'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.979819 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b53d64aa7e442e845d47c31e0e2a6d', 'request_id': 'req-700ac9c5-20f4-4461-94e3-2f9c904f6638'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.994006 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] The token cache is being invalidate because project b4b53d64aa7e442e845d47c31e0e2a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:42.994677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:42.995554 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:43.010224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1337/2677] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:42 2022] DELETE /identity/v3/projects/b4b53d64aa7e442e845d47c31e0e2a6d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:43.048059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:43.063648 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f54f5-98fa-48f7-bb44-ce4e8907d0ae admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:43.072231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:43.073277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.073456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.074171 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.075495 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:43.078151 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:43.111798 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1341/2678] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:42 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:43.117395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:43.119288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:43.215231 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:43.220293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac9c5-20f4-4461-94e3-2f9c904f6638 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:43.228238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:43.229281 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.229720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.230107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.230939 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:43.233366 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:43.248690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1338/2679] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:43.253417 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:43.265839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ccc0-01ab-4f5d-a137-18be8ac95367 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:43.271506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:43.272222 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.272512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.272826 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] PATH_INFO: `/v3/projects/54daf5be0b3d4bb09bdcceb7194ce899/users/a378bb74701d4491819460ca46832a3f/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.294997 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54daf5be0b3d4bb09bdcceb7194ce899, user_id=a378bb74701d4491819460ca46832a3f, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:43.297628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:43.318510 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1342/2680] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:43 2022] PUT /identity/v3/projects/54daf5be0b3d4bb09bdcceb7194ce899/users/a378bb74701d4491819460ca46832a3f/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:43.325191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:43.336275 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b7347-c2c4-4caf-a96e-6a1c2ac82ee4 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:43.405906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff96804-1a45-4a54-a14e-7f1cebe3abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:43.406536 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff96804-1a45-4a54-a14e-7f1cebe3abcb admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.406838 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff96804-1a45-4a54-a14e-7f1cebe3abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.407138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff96804-1a45-4a54-a14e-7f1cebe3abcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.407828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff96804-1a45-4a54-a14e-7f1cebe3abcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:43.409681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff96804-1a45-4a54-a14e-7f1cebe3abcb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:43.420047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1339/2681] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:43.424570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:43.436583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d39d61-924c-4380-8173-7f8e5de71af6 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:43.441694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:43.442398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.442676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.442948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] PATH_INFO: `/v3/projects/54daf5be0b3d4bb09bdcceb7194ce899/users/a378bb74701d4491819460ca46832a3f/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.445364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=54daf5be0b3d4bb09bdcceb7194ce899, user_id=a378bb74701d4491819460ca46832a3f, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:43.448119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:43.460963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1343/2682] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:43 2022] PUT /identity/v3/projects/54daf5be0b3d4bb09bdcceb7194ce899/users/a378bb74701d4491819460ca46832a3f/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:43.533141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.533429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.533711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.564109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] MFA Rules not processed for user `a378bb74701d4491819460ca46832a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:43.565344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:43.638323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1340/2683] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:43.649562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:43.651665 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:43.727201 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb359aa2-9eb8-4805-8da3-0b191efb51dd admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:43.732405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:43.733199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:43.733493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:43.733817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:43.735933 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:43.806734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:43.809121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:43.820796 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1344/2684] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:45.983547 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:45.985110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:46.061138 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12ab5-6916-4828-9980-208847be9089 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.069269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.070321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.070638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.071079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] PATH_INFO: `/v3/users/7b478a587aa7484898b16e6fd5564253` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.073049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b478a587aa7484898b16e6fd5564253)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.075371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.093733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:46.130980 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b478a587aa7484898b16e6fd5564253'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.131683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b478a587aa7484898b16e6fd5564253'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.132298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b478a587aa7484898b16e6fd5564253'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.140855 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b478a587aa7484898b16e6fd5564253'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.148116 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b478a587aa7484898b16e6fd5564253'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.167789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1341/2685] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:45 2022] DELETE /identity/v3/users/7b478a587aa7484898b16e6fd5564253 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:46.357401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.372485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8844-a923-4375-8cda-fbad65bf2039 service cinder] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.432670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.433307 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.433662 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.434035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] PATH_INFO: `/v3/projects/1272d3f95b374cf48ddbac0e796ffea0` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.435391 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1272d3f95b374cf48ddbac0e796ffea0)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.437382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.438956 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:46.441960 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.443590 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:46.457417 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1663f-19a7-4e7f-8b53-e8b27df28e05 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.462152 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.462787 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.463079 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.463359 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] PATH_INFO: `/v3/users/4057f374a19042b3bfaf7fcfb4aa883d` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.464842 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4057f374a19042b3bfaf7fcfb4aa883d)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.466996 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.491040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1272d3f95b374cf48ddbac0e796ffea0', 'request_id': 'req-bba834ba-a192-4189-9620-e9ee9a40aee9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.497549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1272d3f95b374cf48ddbac0e796ffea0', 'request_id': 'req-bba834ba-a192-4189-9620-e9ee9a40aee9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.504259 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1272d3f95b374cf48ddbac0e796ffea0', 'request_id': 'req-bba834ba-a192-4189-9620-e9ee9a40aee9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.517820 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] The token cache is being invalidate because project 1272d3f95b374cf48ddbac0e796ffea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:46.518200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.518848 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-bba834ba-a192-4189-9620-e9ee9a40aee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.519344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4057f374a19042b3bfaf7fcfb4aa883d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.519987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4057f374a19042b3bfaf7fcfb4aa883d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.520386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1345/2686] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:46 2022] DELETE /identity/v3/projects/1272d3f95b374cf48ddbac0e796ffea0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:46.520572 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4057f374a19042b3bfaf7fcfb4aa883d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.525688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156510d-2fab-4a75-be7f-6558614ec3ae None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.525968 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156510d-2fab-4a75-be7f-6558614ec3ae None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.526241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156510d-2fab-4a75-be7f-6558614ec3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.529505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4057f374a19042b3bfaf7fcfb4aa883d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.536737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-32e8653b-a36c-49aa-b24c-ca9afeb24820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4057f374a19042b3bfaf7fcfb4aa883d'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:46.547239 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a156510d-2fab-4a75-be7f-6558614ec3ae None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:46.548524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a156510d-2fab-4a75-be7f-6558614ec3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:46.554954 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1342/2687] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:46 2022] DELETE /identity/v3/users/4057f374a19042b3bfaf7fcfb4aa883d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:46.560078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.560369 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.560644 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.585880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:46.587816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:46.625565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1346/2688] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:46.634719 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.635023 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.635334 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.657865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1343/2689] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:46.658156 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:46.659415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:46.670092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1347/2690] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:46.672194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.673768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:46.674581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.685114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf430e3-7379-463b-a6e0-487699416d42 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.685942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:46.690529 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.691268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.691657 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.692016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.693176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:46.693176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.695271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.708518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1348/2691] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:46.713087 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.723777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317dadd-fb7e-477e-a889-64c61a24357d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.728691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.729042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.729388 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.729726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.730583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.732682 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.747680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1c82-743e-444f-87c1-ceabd563baae None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.753034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.753613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.753893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.754293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.765020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1349/2692] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:46 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:46.766098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.767797 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.769378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.779164 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1344/2693] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:46.827755 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:46.843072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec90ea-ccca-438b-b686-4a170837be45 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.848500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.849175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.849521 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.849842 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.850485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.852493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.877738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1350/2694] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:46 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:46.879293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.889883 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0a9d1-ce3b-4896-a110-5b74d5a7414a service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.894790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.895438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.895719 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.895986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.896627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.898549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.909237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1345/2695] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:46.913540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.925119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855233-f9ac-49e3-a858-17f79a2aefd5 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.930961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e41f6-18b9-41d7-b8dd-f3943fd8f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.931647 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e41f6-18b9-41d7-b8dd-f3943fd8f6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.931929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e41f6-18b9-41d7-b8dd-f3943fd8f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.932223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e41f6-18b9-41d7-b8dd-f3943fd8f6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.932884 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e41f6-18b9-41d7-b8dd-f3943fd8f6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.934635 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e41f6-18b9-41d7-b8dd-f3943fd8f6a5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:46.947653 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1351/2696] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:46.952382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:46.963514 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c9469-3b6c-4fee-829c-54da8b2a628c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:46.969617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:46.970509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:46.970633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:46.970860 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] PATH_INFO: `/v3/projects/831d66108e5843d5b88d1ed017ba74df/users/c7ed2f9967c9496799932be922013f8a/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:46.987001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831d66108e5843d5b88d1ed017ba74df, user_id=c7ed2f9967c9496799932be922013f8a, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:46.989722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.003776 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1346/2697] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:46 2022] PUT /identity/v3/projects/831d66108e5843d5b88d1ed017ba74df/users/c7ed2f9967c9496799932be922013f8a/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:47.015369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.015683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.015986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.045994 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] MFA Rules not processed for user `c7ed2f9967c9496799932be922013f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:47.047281 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.065430 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.067845 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.122652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1352/2698] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:47.127235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.149781 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed37b5-b47f-4a00-9689-d72e059bf631 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.154714 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.155395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.155683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.155955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] PATH_INFO: `/v3/projects/df9ab9d4df424a6da632daea7b7c0638` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.157110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9ab9d4df424a6da632daea7b7c0638)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.159034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.201591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985d93-6c00-4aee-bf40-e52958427288 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.215798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9ab9d4df424a6da632daea7b7c0638', 'request_id': 'req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.222142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9ab9d4df424a6da632daea7b7c0638', 'request_id': 'req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.227881 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9ab9d4df424a6da632daea7b7c0638', 'request_id': 'req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.241987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] The token cache is being invalidate because project df9ab9d4df424a6da632daea7b7c0638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:47.242278 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.242920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.244760 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1347/2699] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:47 2022] DELETE /identity/v3/projects/df9ab9d4df424a6da632daea7b7c0638 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:47.248722 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.250107 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.256063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:47.260263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.260908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.261176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.262315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.262315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.264664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.274608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:47.299502 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1353/2700] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:47 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:47.300947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.303285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.321641 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8b59-d40b-4fc8-a5d7-ae122d0ef163 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.374785 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711c0b-79b9-473b-a8ed-ea232dcb9d87 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.379817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.380430 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.380707 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.380966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.381590 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.381707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.382384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.382664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.382940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] PATH_INFO: `/v3/users/a378bb74701d4491819460ca46832a3f` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.383561 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.384148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a378bb74701d4491819460ca46832a3f)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.386104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.409345 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1354/2701] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:47 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:47.413688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.424496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc2d8-d879-42a3-9397-d77344a770a1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.431348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.432001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.432295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.432564 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.433226 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.435114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.438892 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a378bb74701d4491819460ca46832a3f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.439606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a378bb74701d4491819460ca46832a3f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.440247 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a378bb74701d4491819460ca46832a3f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.446925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1355/2702] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:47.451748 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.453018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a378bb74701d4491819460ca46832a3f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.454423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.460852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a378bb74701d4491819460ca46832a3f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.468179 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ffbea-9739-4ec3-bc24-f73664d54a8b admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.473783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.474451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.474733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.475013 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] PATH_INFO: `/v3/projects/c95e83550c32421fb01270a08715a06c/users/3f99dd1991f8455bb182baff5d34b01a/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.479304 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1348/2703] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:47 2022] DELETE /identity/v3/users/a378bb74701d4491819460ca46832a3f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:47.491184 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95e83550c32421fb01270a08715a06c, user_id=3f99dd1991f8455bb182baff5d34b01a, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.493889 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.508734 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1356/2704] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:47 2022] PUT /identity/v3/projects/c95e83550c32421fb01270a08715a06c/users/3f99dd1991f8455bb182baff5d34b01a/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:47.514172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.561600 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:47.598552 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034a5f-2d2a-4ae6-b056-11ed49e5bc7a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.667865 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4586421-66d8-4b60-b53a-ee812605afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.668462 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4586421-66d8-4b60-b53a-ee812605afa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.668768 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4586421-66d8-4b60-b53a-ee812605afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.669117 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4586421-66d8-4b60-b53a-ee812605afa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.669769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4586421-66d8-4b60-b53a-ee812605afa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.671495 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4586421-66d8-4b60-b53a-ee812605afa2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.682169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1349/2705] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:47.687195 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.700399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f477-4f59-45cc-b0cd-3b59e7f1ade0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.707593 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.708382 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.708726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.709124 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] PATH_INFO: `/v3/projects/c95e83550c32421fb01270a08715a06c/users/3f99dd1991f8455bb182baff5d34b01a/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.711287 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95e83550c32421fb01270a08715a06c, user_id=3f99dd1991f8455bb182baff5d34b01a, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.713972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.725917 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1357/2706] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:47 2022] PUT /identity/v3/projects/c95e83550c32421fb01270a08715a06c/users/3f99dd1991f8455bb182baff5d34b01a/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:47.736565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.736843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.737109 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.771825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] MFA Rules not processed for user `3f99dd1991f8455bb182baff5d34b01a`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:47.773153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.782845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.785339 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.862900 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1350/2707] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:47.874632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddbbd6-5a61-45a9-aa2e-966c8e4b3b9c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.874833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:47.876505 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:47.879612 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.880258 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.880536 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.880815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] PATH_INFO: `/v3/projects/54daf5be0b3d4bb09bdcceb7194ce899` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.882028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54daf5be0b3d4bb09bdcceb7194ce899)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:47.884028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:47.927860 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:47.944970 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54daf5be0b3d4bb09bdcceb7194ce899', 'request_id': 'req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.945624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e97b9-be8f-4477-ab24-7918bda9a0f2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:47.952777 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54daf5be0b3d4bb09bdcceb7194ce899', 'request_id': 'req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.957649 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:47.960191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54daf5be0b3d4bb09bdcceb7194ce899', 'request_id': 'req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.973530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] The token cache is being invalidate because project 54daf5be0b3d4bb09bdcceb7194ce899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:47.974123 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.974459 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-6a48fc1f-941c-48a0-bb3b-f50c3ff9f36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:47.976228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1358/2708] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:47 2022] DELETE /identity/v3/projects/54daf5be0b3d4bb09bdcceb7194ce899 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:47.980910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6304d3-470c-4d97-84bd-faf955ef7fc2 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.981199 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6304d3-470c-4d97-84bd-faf955ef7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.981475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6304d3-470c-4d97-84bd-faf955ef7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:47.998559 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:47.999221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:47.999509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:47.999784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.000916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-fa6304d3-470c-4d97-84bd-faf955ef7fc2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:48.001599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.002136 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-fa6304d3-470c-4d97-84bd-faf955ef7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.066621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1359/2709] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:48.071410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.072856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.075317 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.075539 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.075903 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.083617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1351/2710] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:48.097872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:48.099104 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.107389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1360/2711] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:48.112761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.126870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1c89-dd0a-4639-9f31-0f392725bdb3 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.133312 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.133975 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.134249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.134519 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.135232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:48.135538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.137432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.154836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1352/2712] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:48.160040 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.169980 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9028-3d30-4f42-9f62-317c8067076b None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.175304 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.176134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.176419 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.176688 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.177316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.179556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.215588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1361/2713] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:48 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:48.220428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.232550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f696c-8168-420d-a8e5-fe9b6c3ce802 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.256483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.258296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.298852 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.299509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.299800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.300077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.300736 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.302742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.330742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1353/2714] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:48 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:48.331960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5287b1-808a-4c40-97f3-436211f5d0ff admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.335125 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.337017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.337683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.337959 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.338230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] PATH_INFO: `/v3/users/c7ed2f9967c9496799932be922013f8a` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.339427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ed2f9967c9496799932be922013f8a)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.341544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.346167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbed45-0794-40c5-abd0-29d2b1e73e8c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.351447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.352075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.352354 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.353102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.353807 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.355908 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.369362 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1354/2715] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:48.374131 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.384410 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:48.386800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4bc37-1b3b-4f46-a9f4-0b7730ef1e45 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.393994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.394898 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.395385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.395809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.395948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ed2f9967c9496799932be922013f8a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:48.396667 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ed2f9967c9496799932be922013f8a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:48.396791 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.400345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.406853 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ed2f9967c9496799932be922013f8a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:48.407537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ed2f9967c9496799932be922013f8a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:48.413708 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1355/2716] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:48.417022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-94688a1c-ece4-4652-a00b-3b1bdf5fda72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ed2f9967c9496799932be922013f8a'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:48.418268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.420538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.433117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1362/2717] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:48 2022] DELETE /identity/v3/users/c7ed2f9967c9496799932be922013f8a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:48.433811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba1648-0313-4502-aa7d-aba6780c7ec3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.437465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.437751 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.438020 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.451243 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:48.457584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:48.458874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.493465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db79bfd-6871-4d17-8a57-fb74dfeaab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.494124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db79bfd-6871-4d17-8a57-fb74dfeaab6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.494405 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db79bfd-6871-4d17-8a57-fb74dfeaab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.494682 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db79bfd-6871-4d17-8a57-fb74dfeaab6f admin admin] PATH_INFO: `/v3/projects/435f4e3cebf54f569dac00095433a5e3/users/d8b222b303464d83b06353d33876a02f/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.509804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db79bfd-6871-4d17-8a57-fb74dfeaab6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=435f4e3cebf54f569dac00095433a5e3, user_id=d8b222b303464d83b06353d33876a02f, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.513048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db79bfd-6871-4d17-8a57-fb74dfeaab6f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.520811 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1363/2718] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:48.529072 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1356/2719] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:48 2022] PUT /identity/v3/projects/435f4e3cebf54f569dac00095433a5e3/users/d8b222b303464d83b06353d33876a02f/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:48.539263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.539263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.541388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.541680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.541959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.570606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] MFA Rules not processed for user `d8b222b303464d83b06353d33876a02f`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:48.571839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.598923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d504d-6e5a-41d6-80e5-1a795be77087 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.644816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1357/2720] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:48.651412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752913-c583-449d-808a-371e624417fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.652027 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752913-c583-449d-808a-371e624417fc service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.652346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752913-c583-449d-808a-371e624417fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.652618 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752913-c583-449d-808a-371e624417fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.656830 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:48.658276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:48.676622 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:48.724235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752913-c583-449d-808a-371e624417fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.724613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd7c93-e592-4c2d-8012-fac09461126d None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:48.725591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752913-c583-449d-808a-371e624417fc service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.728423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:48.729036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:48.729323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:48.729591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:48.735545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1364/2721] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:48.741546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:48.742987 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:48.752594 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1358/2722] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:49.027400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752913-c583-449d-808a-371e624417fc service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:49.028931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b6752913-c583-449d-808a-371e624417fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:49.041954 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752913-c583-449d-808a-371e624417fc service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:49.049131 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:49.049899 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:49.050180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:49.050450 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] PATH_INFO: `/v3/projects/831d66108e5843d5b88d1ed017ba74df` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:49.052948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831d66108e5843d5b88d1ed017ba74df)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:49.055035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:49.108988 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831d66108e5843d5b88d1ed017ba74df', 'request_id': 'req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.115764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831d66108e5843d5b88d1ed017ba74df', 'request_id': 'req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.123692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831d66108e5843d5b88d1ed017ba74df', 'request_id': 'req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.136405 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] The token cache is being invalidate because project 831d66108e5843d5b88d1ed017ba74df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:49.136987 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.137462 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.139178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1365/2723] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:49 2022] DELETE /identity/v3/projects/831d66108e5843d5b88d1ed017ba74df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:49.143169 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:49.167628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc3885-dd83-47f8-b605-6c789ad91c14 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:49.339856 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:49.366927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:49.367597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:49.367875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:49.368145 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] PATH_INFO: `/v3/users/3f99dd1991f8455bb182baff5d34b01a` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:49.369265 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f99dd1991f8455bb182baff5d34b01a)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:49.371469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:49.422977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f99dd1991f8455bb182baff5d34b01a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.423707 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f99dd1991f8455bb182baff5d34b01a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.424468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f99dd1991f8455bb182baff5d34b01a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.432481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f99dd1991f8455bb182baff5d34b01a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.440680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-23498957-263c-452e-a03b-81442eb72698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f99dd1991f8455bb182baff5d34b01a'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.459894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1359/2724] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:49 2022] DELETE /identity/v3/users/3f99dd1991f8455bb182baff5d34b01a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:49.760771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:49.762639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:49.777118 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d433c-f52d-427a-9c3c-18d6c3bc0eb1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:49.844454 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:49.845102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:49.845378 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:49.845642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] PATH_INFO: `/v3/projects/c95e83550c32421fb01270a08715a06c` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:49.846862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95e83550c32421fb01270a08715a06c)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:49.848851 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:49.900690 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:49.905658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95e83550c32421fb01270a08715a06c', 'request_id': 'req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.913559 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95e83550c32421fb01270a08715a06c', 'request_id': 'req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.921696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95e83550c32421fb01270a08715a06c', 'request_id': 'req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.935723 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] The token cache is being invalidate because project c95e83550c32421fb01270a08715a06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:49.935984 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.936733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-45cfeb08-6bcb-4bbb-bb2f-f976dc3f4717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:49.938308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1366/2725] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:49 2022] DELETE /identity/v3/projects/c95e83550c32421fb01270a08715a06c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:49.944469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:49.945103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:49.945379 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:49.967239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:49.968568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:50.034070 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1360/2726] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:50.048492 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.048778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.049052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.069457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:50.071107 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:50.079902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1367/2727] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:50.084382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.094571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd3b1f-954c-47ae-bd0b-00106f36dee7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.100596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.101282 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.101489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.101803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.104388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:50.104388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.104388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.118551 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1361/2728] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:07:50.123245 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.132921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947769-d372-4c66-a888-f4db30c3c86a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.138632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.139571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.140014 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.140446 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.141477 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.144048 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.178912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1368/2729] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:50 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:07:50.183249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.194986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34513-0612-4770-bb27-00ac993268ad admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.240003 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:50.261447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.262078 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.262365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.262806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.264083 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.266186 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.293451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1362/2730] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:50 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:50.298091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.310445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4ce5-56d3-4faa-87fb-1d86a072846c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.318596 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.320181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.320655 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.321042 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.322031 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.323978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.340072 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1369/2731] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:50.342422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.355250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80eb6-b7ec-45aa-8fc7-014f6fca4eb6 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.360220 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d8cf0-55e3-406a-a4ab-a8c4bd4c5c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.360836 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8cf0-55e3-406a-a4ab-a8c4bd4c5c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.361106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8cf0-55e3-406a-a4ab-a8c4bd4c5c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.361372 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8cf0-55e3-406a-a4ab-a8c4bd4c5c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.362021 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d8cf0-55e3-406a-a4ab-a8c4bd4c5c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.363737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d8cf0-55e3-406a-a4ab-a8c4bd4c5c4d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.374930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1363/2732] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:50.379971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.393399 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5b77-66d2-439e-a1ef-27f1297eefb1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.399872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.400589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.400872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.402057 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] PATH_INFO: `/v3/projects/a48f6f58c6734d61b00cf2d240083960/users/cd69836023f546788b27bd885f6e8dd7/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.420438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48f6f58c6734d61b00cf2d240083960, user_id=cd69836023f546788b27bd885f6e8dd7, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.423236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.442733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1370/2733] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:50 2022] PUT /identity/v3/projects/a48f6f58c6734d61b00cf2d240083960/users/cd69836023f546788b27bd885f6e8dd7/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:50.453970 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.454287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.454582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.492485 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] MFA Rules not processed for user `cd69836023f546788b27bd885f6e8dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:50.494139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:50.576609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1364/2734] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:50.581517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.662402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b921d5-e918-4686-a26a-f132c64f0ad0 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.667516 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.668190 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.668473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.668743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.669520 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.671685 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.705871 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1371/2735] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:50 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:50.710400 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.722118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067820-bea3-4ba7-86cf-c8fe1f38493f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.783811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.784435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.784716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.784989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.785620 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.787614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.810241 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1365/2736] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:50 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:50.815363 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.829691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c6c07-7caf-4b9c-9c1b-3014e89006ee admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.834946 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.835588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.835874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.836148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.837122 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.838775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.850606 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1372/2737] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:50.856174 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.871510 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5a77-4b86-47a0-8d51-813d4adb12f7 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.877903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:50.878595 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:50.878876 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:50.879192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] PATH_INFO: `/v3/projects/3ee20ad177294d5dadeab92a95e8e082/users/af862b6ad5494923bf2640bba86674b9/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:50.895873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee20ad177294d5dadeab92a95e8e082, user_id=af862b6ad5494923bf2640bba86674b9, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:50.898744 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:50.920848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1366/2738] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:50 2022] PUT /identity/v3/projects/3ee20ad177294d5dadeab92a95e8e082/users/af862b6ad5494923bf2640bba86674b9/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:50.925223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:50.936563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38add2-7b58-44ae-8d2e-9121bacf87ef admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:50.990754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:51.013353 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e158f-ff48-474b-86d8-199dc0dc0eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:51.014133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e158f-ff48-474b-86d8-199dc0dc0eed admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:51.014264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e158f-ff48-474b-86d8-199dc0dc0eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:51.014532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e158f-ff48-474b-86d8-199dc0dc0eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:51.015251 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e158f-ff48-474b-86d8-199dc0dc0eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:51.016910 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e158f-ff48-474b-86d8-199dc0dc0eed admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:51.028901 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1373/2739] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:51.033203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:51.047284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402f22d-fb96-4e7c-a0c1-b33dc71976a0 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:51.055459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:51.056196 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:51.056471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:51.056737 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] PATH_INFO: `/v3/projects/3ee20ad177294d5dadeab92a95e8e082/users/af862b6ad5494923bf2640bba86674b9/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:51.058749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee20ad177294d5dadeab92a95e8e082, user_id=af862b6ad5494923bf2640bba86674b9, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:51.061752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:51.073654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1367/2740] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:51 2022] PUT /identity/v3/projects/3ee20ad177294d5dadeab92a95e8e082/users/af862b6ad5494923bf2640bba86674b9/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:51.084770 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:51.085058 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:51.085338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:51.118456 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] MFA Rules not processed for user `af862b6ad5494923bf2640bba86674b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:51.119838 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:51.203855 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1374/2741] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:51.215995 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:51.218414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:51.224148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:51.280130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b0d2-057f-4a04-8938-3854d418cc06 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:51.284319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb261e38-8112-4062-87a0-088fa3387bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:51.284931 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261e38-8112-4062-87a0-088fa3387bbf service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:51.285207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261e38-8112-4062-87a0-088fa3387bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:51.285473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb261e38-8112-4062-87a0-088fa3387bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:51.295034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261e38-8112-4062-87a0-088fa3387bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:51.296489 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb261e38-8112-4062-87a0-088fa3387bbf service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:51.305933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1368/2742] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:51.959714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:52.034148 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7204a-6cbd-4c8a-a6c9-7ec05793d7c1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:52.039006 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:52.039864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:52.040216 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:52.040532 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] PATH_INFO: `/v3/users/cd69836023f546788b27bd885f6e8dd7` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:52.041981 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd69836023f546788b27bd885f6e8dd7)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:52.044373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:52.227738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd69836023f546788b27bd885f6e8dd7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.228420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd69836023f546788b27bd885f6e8dd7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.236095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd69836023f546788b27bd885f6e8dd7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.236738 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd69836023f546788b27bd885f6e8dd7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.243605 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd69836023f546788b27bd885f6e8dd7'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.245440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:52.261832 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1375/2743] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:51 2022] DELETE /identity/v3/users/cd69836023f546788b27bd885f6e8dd7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:52.266577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:52.267170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:52.267170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:52.286002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:52.287226 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:52.345683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1369/2744] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:52.355852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:52.357781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:52.422228 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb207-49bb-4e65-8346-6ddee2c39b70 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:52.426712 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:52.427376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:52.427706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:52.427932 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:52.437599 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:52.439037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:52.448926 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1376/2745] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:52.732308 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:52.733835 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:52.750713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeeb77-d33c-4261-9023-69a3dd8aede1 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:52.755329 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:52.755974 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:52.756255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:52.756546 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] PATH_INFO: `/v3/projects/a48f6f58c6734d61b00cf2d240083960` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:52.757920 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48f6f58c6734d61b00cf2d240083960)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:52.760018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:52.813677 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48f6f58c6734d61b00cf2d240083960', 'request_id': 'req-97642e1c-082d-4fda-bb44-b7d3bed0ff01'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.821475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48f6f58c6734d61b00cf2d240083960', 'request_id': 'req-97642e1c-082d-4fda-bb44-b7d3bed0ff01'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.827893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48f6f58c6734d61b00cf2d240083960', 'request_id': 'req-97642e1c-082d-4fda-bb44-b7d3bed0ff01'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.848659 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] The token cache is being invalidate because project a48f6f58c6734d61b00cf2d240083960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:52.848943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.849569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.851108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1370/2746] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:52 2022] DELETE /identity/v3/projects/a48f6f58c6734d61b00cf2d240083960 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:52.855175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:52.865288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f502d1-01a1-499a-b52b-0526562b7d48 service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:52.925358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:52.926010 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:52.926285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:52.926562 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] PATH_INFO: `/v3/users/af862b6ad5494923bf2640bba86674b9` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:52.927865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af862b6ad5494923bf2640bba86674b9)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:52.929857 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:52.980196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af862b6ad5494923bf2640bba86674b9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.981077 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af862b6ad5494923bf2640bba86674b9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.989293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af862b6ad5494923bf2640bba86674b9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.989986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af862b6ad5494923bf2640bba86674b9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:52.997998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-16c81b87-0646-4db0-9ed2-d1f1bcdc4633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af862b6ad5494923bf2640bba86674b9'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.017297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1377/2747] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:52 2022] DELETE /identity/v3/users/af862b6ad5494923bf2640bba86674b9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:53.318545 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.320739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:53.334638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642e1c-082d-4fda-bb44-b7d3bed0ff01 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.364191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:53.399549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.400158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.400431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.400701 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] PATH_INFO: `/v3/projects/3ee20ad177294d5dadeab92a95e8e082` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.401871 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee20ad177294d5dadeab92a95e8e082)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.403818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.456634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee20ad177294d5dadeab92a95e8e082', 'request_id': 'req-44249dd6-dfd6-4100-b7a9-352f3911bac2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.464660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee20ad177294d5dadeab92a95e8e082', 'request_id': 'req-44249dd6-dfd6-4100-b7a9-352f3911bac2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.471191 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee20ad177294d5dadeab92a95e8e082', 'request_id': 'req-44249dd6-dfd6-4100-b7a9-352f3911bac2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.484326 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] The token cache is being invalidate because project 3ee20ad177294d5dadeab92a95e8e082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:53.484613 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.485237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-44249dd6-dfd6-4100-b7a9-352f3911bac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.486782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1371/2748] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:53 2022] DELETE /identity/v3/projects/3ee20ad177294d5dadeab92a95e8e082 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:53.491902 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.492193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.492466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.502127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:53.514623 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:53.516862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:53.579457 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1378/2749] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:53.587603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.587914 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.588184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.609093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:53.610401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:53.619240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1372/2750] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:53.623885 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.633706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a250dee-4ebd-4903-b9c2-5b82e85db4e1 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.638469 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.639255 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.639412 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.639659 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.640290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:53.640585 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.642203 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.654185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1379/2751] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:53.658810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.668663 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80550d8a-0864-4ad0-9c90-8bb48f1c93f6 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.674167 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.674806 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.675102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.675385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.676019 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.677988 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.707581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1373/2752] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:53 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:53.712076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.722911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee103a-01d7-4d51-8b13-63d21039dfa1 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.785552 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.786188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.786448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.786711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.787366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.789315 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.816147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1380/2753] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:53 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:53.820778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.831738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd574799-a714-49c3-adee-072eb6fa5c26 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.836978 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.837953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.838411 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.838873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.840104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.842821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.857034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1374/2754] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:53.861923 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.873683 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54418ef-ccca-4603-8eb2-7bc49916bee4 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.876624 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.878528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:53.878675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.879189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.879468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.879791 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.880422 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.882024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.892042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632a0d8-812d-4d00-b440-848b7d37fc49 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.893352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1381/2755] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:53.897097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.897631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:53.897752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.897998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.898268 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] PATH_INFO: `/v3/users/d8b222b303464d83b06353d33876a02f` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.899446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b222b303464d83b06353d33876a02f)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.901371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.907867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91eec-a11a-4345-b7af-a6b3ed2d4a4f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:53.912795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39910-0716-4e71-b863-660d3b0b447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:53.913443 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39910-0716-4e71-b863-660d3b0b447e admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.913726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39910-0716-4e71-b863-660d3b0b447e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.914025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39910-0716-4e71-b863-660d3b0b447e admin admin] PATH_INFO: `/v3/projects/948fdd40ce0845b586961e0bc847bbb7/users/90644856ad4f4015b21e0d644d75d560/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.929735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39910-0716-4e71-b863-660d3b0b447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=948fdd40ce0845b586961e0bc847bbb7, user_id=90644856ad4f4015b21e0d644d75d560, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:53.932556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39910-0716-4e71-b863-660d3b0b447e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:53.946279 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1382/2756] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:53 2022] PUT /identity/v3/projects/948fdd40ce0845b586961e0bc847bbb7/users/90644856ad4f4015b21e0d644d75d560/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:53.953124 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b222b303464d83b06353d33876a02f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.953882 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b222b303464d83b06353d33876a02f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.954597 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b222b303464d83b06353d33876a02f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.956905 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.957196 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.957475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:53.963509 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b222b303464d83b06353d33876a02f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.970796 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-31309ba3-3435-47fd-a341-413a27e91da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b222b303464d83b06353d33876a02f'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:53.980022 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:53.988236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] MFA Rules not processed for user `90644856ad4f4015b21e0d644d75d560`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:53.989794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:53.992710 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1375/2757] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:53 2022] DELETE /identity/v3/users/d8b222b303464d83b06353d33876a02f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:53.997121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:53.997410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:53.997689 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.016431 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:54.017645 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.027367 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:54.062482 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1383/2758] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:54.067735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.069338 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.080277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1376/2759] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:54.090432 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.092609 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.137549 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ee2d5-3e15-4ac9-b511-c1b2e8f891b4 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.143351 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.144056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.144517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.144795 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.145498 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.147394 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.156035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be3f9f-637c-42b1-b713-3e37160391d2 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.159825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.160385 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.160664 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.160961 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.171818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.173448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.183518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1384/2760] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:54.184052 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1377/2761] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:54.188127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.253686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1444167-0db6-48b4-a730-3110e52a9afe admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.259180 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.259829 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.260154 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.260448 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.261369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.264500 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.289908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1385/2762] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:54.291279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.301439 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff6206-7cd7-4670-9dde-268dfa4e73a6 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.306306 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.306989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.307401 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.307676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.308319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.310036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.322163 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1378/2763] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:54.326658 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.341321 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f6499-facb-49ef-99c9-0284c98f4902 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.346015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.346764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.347146 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.347440 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] PATH_INFO: `/v3/projects/57d8d1b0b5cc4e9183093ddf0571bc7a/users/8c776eee3b2b4b1eba18af826de90384/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.363615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d8d1b0b5cc4e9183093ddf0571bc7a, user_id=8c776eee3b2b4b1eba18af826de90384, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.366346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.381836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1386/2764] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:54 2022] PUT /identity/v3/projects/57d8d1b0b5cc4e9183093ddf0571bc7a/users/8c776eee3b2b4b1eba18af826de90384/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:54.386049 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.397066 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d780ed7-2e16-49e4-8bf2-3fe7776ac30b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.465429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.466179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.466561 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.466935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.467657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.470792 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.471941 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.473754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.480862 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1379/2765] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:54.485454 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.488049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446d69-8ae7-49c5-a8d5-2a5073cc3591 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.492807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.493588 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.493754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.494024 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] PATH_INFO: `/v3/projects/435f4e3cebf54f569dac00095433a5e3` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.495451 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] RBAC: Authorizing `identity:delete_project(project_id=435f4e3cebf54f569dac00095433a5e3)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.496448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32284db-99f4-4a7e-bec4-373b32a8c11d admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.497911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.501940 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242e0ea-be1f-46bc-9259-8c82303194b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.503162 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e0ea-be1f-46bc-9259-8c82303194b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.503535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e0ea-be1f-46bc-9259-8c82303194b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.504041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e0ea-be1f-46bc-9259-8c82303194b7 admin admin] PATH_INFO: `/v3/projects/57d8d1b0b5cc4e9183093ddf0571bc7a/users/8c776eee3b2b4b1eba18af826de90384/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.506612 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242e0ea-be1f-46bc-9259-8c82303194b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d8d1b0b5cc4e9183093ddf0571bc7a, user_id=8c776eee3b2b4b1eba18af826de90384, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.509358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242e0ea-be1f-46bc-9259-8c82303194b7 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.520438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1380/2766] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:54 2022] PUT /identity/v3/projects/57d8d1b0b5cc4e9183093ddf0571bc7a/users/8c776eee3b2b4b1eba18af826de90384/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:54.522962 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:54.531896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.532313 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.532711 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.548092 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:54.554765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435f4e3cebf54f569dac00095433a5e3', 'request_id': 'req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:54.561342 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435f4e3cebf54f569dac00095433a5e3', 'request_id': 'req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:54.565356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] MFA Rules not processed for user `8c776eee3b2b4b1eba18af826de90384`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:54.566584 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.567622 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435f4e3cebf54f569dac00095433a5e3', 'request_id': 'req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:54.582784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] The token cache is being invalidate because project 435f4e3cebf54f569dac00095433a5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:54.583167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:54.583840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-65d8b234-38d0-4bdb-a89c-d3c3a7ce432e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:54.585406 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1387/2767] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:54 2022] DELETE /identity/v3/projects/435f4e3cebf54f569dac00095433a5e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:54.590241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55038b2e-2b3b-4a10-9512-f8ed780ed455 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.590592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55038b2e-2b3b-4a10-9512-f8ed780ed455 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.591147 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55038b2e-2b3b-4a10-9512-f8ed780ed455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.611583 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-55038b2e-2b3b-4a10-9512-f8ed780ed455 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:54.612801 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-55038b2e-2b3b-4a10-9512-f8ed780ed455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.637302 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1381/2768] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:54.648894 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.650968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.691278 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1388/2769] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:07:54.700121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.700921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.700921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.720240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e02cb-8e0f-4d99-aef9-2e2cac14953b None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.720865 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:54.722046 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:54.724234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.725321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.725321 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.725577 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.734084 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1389/2770] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:54.735994 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.737451 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.738550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.748007 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1382/2771] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:54.748817 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816fe7-8606-4ead-8e63-283ff646acbb None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.754493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.755153 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.755415 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.755687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.756344 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:54.756642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.758235 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.771595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1390/2772] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:07:54.776611 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.788380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ce1d-1db3-412d-8fd6-76d7e279da80 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.793492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.794334 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.794942 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.799318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.799318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.799318 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.828941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1383/2773] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:54.833306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.849256 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0ba1-8993-4c97-8401-279e1cf5b154 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.919098 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.919754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.920051 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.920303 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.920947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.922914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.949240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1391/2774] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:54 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:54.950531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:54.962671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb161b7-eb1d-43ce-86b5-e551a137506b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:54.969048 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:54.969668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:54.969947 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:54.970215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:54.970893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:54.972553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:54.985301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1384/2775] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:54.989518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:55.000794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c930f-dab5-434b-bb28-ed2af5ea1c0d admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:55.005524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a889d-2b6f-4641-b2eb-51d9a10adab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:55.006158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a889d-2b6f-4641-b2eb-51d9a10adab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.006438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a889d-2b6f-4641-b2eb-51d9a10adab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.006708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a889d-2b6f-4641-b2eb-51d9a10adab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.011731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a889d-2b6f-4641-b2eb-51d9a10adab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:55.011731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a889d-2b6f-4641-b2eb-51d9a10adab5 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:55.024269 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1392/2776] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:07:55.032207 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:55.042651 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f53d8-25c5-4f5c-bfc7-f7947548cb39 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:55.049429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:55.050098 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.050375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.050646 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] PATH_INFO: `/v3/projects/d74965c3b85547a7ae769f7a71bab326/users/6b4ba11f5d9e4c8191bad7d8fa57be10/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.067081 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74965c3b85547a7ae769f7a71bab326, user_id=6b4ba11f5d9e4c8191bad7d8fa57be10, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:55.070091 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:55.085857 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1385/2777] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:55 2022] PUT /identity/v3/projects/d74965c3b85547a7ae769f7a71bab326/users/6b4ba11f5d9e4c8191bad7d8fa57be10/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:55.091749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.092083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.092358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.112879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:55.114676 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:55.121219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:55.143351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:55.145607 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:55.188392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1393/2778] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:55.198329 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:55.198532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:55.199953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:55.221912 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80545e7e-6ebf-41af-ae98-2ff2c799cb11 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:55.226493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:55.227179 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.227458 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.227731 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] PATH_INFO: `/v3/users/90644856ad4f4015b21e0d644d75d560` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.228848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90644856ad4f4015b21e0d644d75d560)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:55.230779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:55.271188 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd43d3-d6e4-435d-b461-f525982431e9 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:55.275028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c3bb-9f5b-4d89-aa43-6b0315a0b172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:55.275671 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c3bb-9f5b-4d89-aa43-6b0315a0b172 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.275953 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c3bb-9f5b-4d89-aa43-6b0315a0b172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.276227 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c3bb-9f5b-4d89-aa43-6b0315a0b172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.279090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90644856ad4f4015b21e0d644d75d560'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:55.279890 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90644856ad4f4015b21e0d644d75d560'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:55.280676 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90644856ad4f4015b21e0d644d75d560'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:55.288231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5c3bb-9f5b-4d89-aa43-6b0315a0b172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:55.289634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5c3bb-9f5b-4d89-aa43-6b0315a0b172 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:55.289943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90644856ad4f4015b21e0d644d75d560'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:55.299822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1394/2779] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:07:55.301149 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90644856ad4f4015b21e0d644d75d560'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:55.326761 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1386/2780] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:55 2022] DELETE /identity/v3/users/90644856ad4f4015b21e0d644d75d560 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:55.331784 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.332081 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.332360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.353220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:55.354485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:55.424139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1395/2781] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:55.435803 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:55.437475 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:55.508337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dc532-d808-4bff-8b92-d0f343130f2a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:55.512288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:55.512989 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:55.513269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:55.513535 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:55.523496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:55.525227 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:55.538703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1387/2782] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:55.992376 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:55.993916 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:56.007737 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4786a-b552-487e-a115-0bbb7a5fdb3c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:56.013484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:56.014402 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:56.014761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:56.015037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] PATH_INFO: `/v3/projects/948fdd40ce0845b586961e0bc847bbb7` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:56.016352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] RBAC: Authorizing `identity:delete_project(project_id=948fdd40ce0845b586961e0bc847bbb7)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:56.018383 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:56.076296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:56.077783 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948fdd40ce0845b586961e0bc847bbb7', 'request_id': 'req-d3923226-4666-4ea1-ab18-f340662f285f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.087165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948fdd40ce0845b586961e0bc847bbb7', 'request_id': 'req-d3923226-4666-4ea1-ab18-f340662f285f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.096491 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948fdd40ce0845b586961e0bc847bbb7', 'request_id': 'req-d3923226-4666-4ea1-ab18-f340662f285f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.111660 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] The token cache is being invalidate because project 948fdd40ce0845b586961e0bc847bbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:56.112102 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.113672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.115162 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1396/2783] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:55 2022] DELETE /identity/v3/projects/948fdd40ce0845b586961e0bc847bbb7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:56.119151 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:56.134215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827bd3e-92ec-40d4-b370-c442127c2733 service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:56.207692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:56.208368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:56.209086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:56.209368 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] PATH_INFO: `/v3/users/8c776eee3b2b4b1eba18af826de90384` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:56.212224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c776eee3b2b4b1eba18af826de90384)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:56.214253 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:56.216155 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:56.281694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c776eee3b2b4b1eba18af826de90384'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.282337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c776eee3b2b4b1eba18af826de90384'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.282932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c776eee3b2b4b1eba18af826de90384'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.294683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c776eee3b2b4b1eba18af826de90384'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.304267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f00ba0e3-860e-4ecf-80fa-77b2e94d9d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c776eee3b2b4b1eba18af826de90384'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.331704 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1388/2784] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:56 2022] DELETE /identity/v3/users/8c776eee3b2b4b1eba18af826de90384 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:56.670298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:56.672528 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:56.689319 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3923226-4666-4ea1-ab18-f340662f285f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:56.768924 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:56.769569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:56.769844 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:56.770109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] PATH_INFO: `/v3/projects/57d8d1b0b5cc4e9183093ddf0571bc7a` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:56.771267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d8d1b0b5cc4e9183093ddf0571bc7a)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:56.773176 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:56.842390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d8d1b0b5cc4e9183093ddf0571bc7a', 'request_id': 'req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.848879 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d8d1b0b5cc4e9183093ddf0571bc7a', 'request_id': 'req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.856944 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d8d1b0b5cc4e9183093ddf0571bc7a', 'request_id': 'req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.876293 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] The token cache is being invalidate because project 57d8d1b0b5cc4e9183093ddf0571bc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:07:56.876720 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.877386 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-24370089-4e1d-41c7-8b15-1ea19c5cb6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:56.880155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1397/2785] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:07:56 2022] DELETE /identity/v3/projects/57d8d1b0b5cc4e9183093ddf0571bc7a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:56.885130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:56.885501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:56.885863 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:56.911288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:56.912587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:57.030497 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1389/2786] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:57.041194 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.041763 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.042100 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.063193 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:57.064535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:57.081158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1398/2787] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:57.087029 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.101086 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81826b4c-3806-4fb4-8d4d-251c88a5f989 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.112553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.113355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.113733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.114097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.114859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:07:57.115298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.117418 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.132840 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1390/2788] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:07:57.136815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.147761 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04bcd6-64b3-43d8-8896-c6678a197255 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.158432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.159130 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.159458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.159730 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.160403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.162348 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.202771 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1399/2789] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:57 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:57.207082 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.217713 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c05ed0-51fb-45be-b085-276a9c327a85 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.282276 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.282927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.283287 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.283558 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.284387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.286412 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.298998 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:57.316657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1391/2790] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:57 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:57.321708 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.335686 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a22a-cebd-4795-af42-f5384716038e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.343571 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.344308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.344778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.345370 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.345839 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.348438 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.365183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1400/2791] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:57.370237 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.381566 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964d9e-f044-4eeb-a60c-2b59717d91ce admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.386374 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5e021-9ce2-420d-a824-d25c79bd1af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.387010 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e021-9ce2-420d-a824-d25c79bd1af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.387317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e021-9ce2-420d-a824-d25c79bd1af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.387717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e021-9ce2-420d-a824-d25c79bd1af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.389108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5e021-9ce2-420d-a824-d25c79bd1af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.390749 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5e021-9ce2-420d-a824-d25c79bd1af8 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.401808 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1392/2792] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:57.406617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.417432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a3387-f2ed-43b2-abd0-efcdf14c3e77 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.422603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.423308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.423611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.424001 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] PATH_INFO: `/v3/projects/352acc5e0f224d89995edd47f304af40/users/3247ada29eda4756bbb22c8019df1aec/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.441030 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352acc5e0f224d89995edd47f304af40, user_id=3247ada29eda4756bbb22c8019df1aec, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.443760 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.459232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1401/2793] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:57 2022] PUT /identity/v3/projects/352acc5e0f224d89995edd47f304af40/users/3247ada29eda4756bbb22c8019df1aec/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:57.470102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.470384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.470653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.501810 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] MFA Rules not processed for user `3247ada29eda4756bbb22c8019df1aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:57.503171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:57.579570 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1393/2794] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:57.584047 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.589138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:57.660782 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd6807-be71-4a7a-95e0-6d2fbc0eb585 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.666143 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.667627 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.667913 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.668191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.668914 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.671346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.709109 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1402/2795] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:07:57 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:57.710615 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.722437 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65540c-b2bb-4529-9938-16aa103465df None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.790812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.791581 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.791925 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.792285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.793156 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.795627 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.824189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1394/2796] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:07:57 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:07:57.825750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.838587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee59e93-4c2f-46a7-802f-13761c5fe9a2 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.845358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.845846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.846286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.847198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.847654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.851445 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.865858 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1403/2797] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:57.870337 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.883234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218ecc8-e06a-49e3-a499-c8ebd6e7364b admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:57.894317 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:57.895492 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:57.896002 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:57.896504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] PATH_INFO: `/v3/projects/d9a7c2ec2f644fd0940a3332968df512/users/0515e09537b84e809dfe9ba8eb9ab6ba/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:57.919103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a7c2ec2f644fd0940a3332968df512, user_id=0515e09537b84e809dfe9ba8eb9ab6ba, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:57.922812 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:57.940239 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1395/2798] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:57 2022] PUT /identity/v3/projects/d9a7c2ec2f644fd0940a3332968df512/users/0515e09537b84e809dfe9ba8eb9ab6ba/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:57.944474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:57.956821 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b9ee6-26b4-43da-9250-f4e685f0008c admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:58.037898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf57b-213c-4c5e-a202-1844dc01cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:58.038603 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf57b-213c-4c5e-a202-1844dc01cc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:58.038881 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf57b-213c-4c5e-a202-1844dc01cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:58.039185 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf57b-213c-4c5e-a202-1844dc01cc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:58.040011 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaf57b-213c-4c5e-a202-1844dc01cc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:58.042059 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaf57b-213c-4c5e-a202-1844dc01cc2e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:58.059775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1404/2799] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:07:58.060469 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:58.072042 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a361668-1782-4dc8-bb0a-c106d41cbfac admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:58.077779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:58.078314 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:58.078668 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:58.079013 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] PATH_INFO: `/v3/projects/d9a7c2ec2f644fd0940a3332968df512/users/0515e09537b84e809dfe9ba8eb9ab6ba/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:58.081528 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a7c2ec2f644fd0940a3332968df512, user_id=0515e09537b84e809dfe9ba8eb9ab6ba, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:58.084093 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:58.097873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1396/2800] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:07:58 2022] PUT /identity/v3/projects/d9a7c2ec2f644fd0940a3332968df512/users/0515e09537b84e809dfe9ba8eb9ab6ba/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:07:58.113484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:58.113850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:58.114191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:58.159207 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] MFA Rules not processed for user `0515e09537b84e809dfe9ba8eb9ab6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:58.161768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:58.253920 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:58.262144 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1405/2801] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:58.276194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:58.278319 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:58.324930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:58.379591 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884665f-ec45-4a62-bef1-07405d13f560 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:58.384652 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:58.385955 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:58.386367 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:58.386653 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:58.401799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:58.403672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:58.420055 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1397/2802] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:58.539594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:58.555642 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02d801-25c5-424e-abcb-6f915650bb66 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:58.560212 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcef121-30b1-46fe-8161-0f85de8944c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:58.561141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef121-30b1-46fe-8161-0f85de8944c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:58.561617 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef121-30b1-46fe-8161-0f85de8944c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:58.562070 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef121-30b1-46fe-8161-0f85de8944c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:58.643034 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcef121-30b1-46fe-8161-0f85de8944c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:58.648895 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcef121-30b1-46fe-8161-0f85de8944c9 service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:58.685892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1406/2803] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:07:59.135574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:59.261039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f040c1-1fbe-4a47-9973-33e9848b0ff1 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:59.267870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:59.268754 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:59.269063 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:59.269521 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] PATH_INFO: `/v3/users/3247ada29eda4756bbb22c8019df1aec` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:59.272089 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3247ada29eda4756bbb22c8019df1aec)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:59.274330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:59.342445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3247ada29eda4756bbb22c8019df1aec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:59.343134 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3247ada29eda4756bbb22c8019df1aec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:59.343709 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3247ada29eda4756bbb22c8019df1aec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:59.359568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3247ada29eda4756bbb22c8019df1aec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:59.369919 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3247ada29eda4756bbb22c8019df1aec'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:07:59.395216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1398/2804] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:07:59 2022] DELETE /identity/v3/users/3247ada29eda4756bbb22c8019df1aec => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:07:59.400513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:59.401096 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:59.401484 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:59.445360 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:07:59.446664 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:59.544574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1407/2805] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:07:59.552263 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:07:59.554133 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:07:59.624111 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:59.629105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff61f6-c002-48b4-bb31-891e555a5936 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:07:59.633034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4134ea7-2af2-442b-beb4-f97c8331044a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:07:59.633959 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4134ea7-2af2-442b-beb4-f97c8331044a service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:07:59.634444 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4134ea7-2af2-442b-beb4-f97c8331044a service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:07:59.634909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4134ea7-2af2-442b-beb4-f97c8331044a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:07:59.649687 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4134ea7-2af2-442b-beb4-f97c8331044a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:07:59.652050 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4134ea7-2af2-442b-beb4-f97c8331044a service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:07:59.664181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1399/2806] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:08:00.041301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.044609 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.055184 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.055474 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.055748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.075369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683d929-21ca-46b4-8c01-456975c90dd7 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.083649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.084595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.085060 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.085481 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] PATH_INFO: `/v3/projects/352acc5e0f224d89995edd47f304af40` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.087229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352acc5e0f224d89995edd47f304af40)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.089570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.105828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] MFA Rules not processed for user `6b4ba11f5d9e4c8191bad7d8fa57be10`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:00.107344 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.157775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352acc5e0f224d89995edd47f304af40', 'request_id': 'req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.167535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352acc5e0f224d89995edd47f304af40', 'request_id': 'req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.178028 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352acc5e0f224d89995edd47f304af40', 'request_id': 'req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.193691 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] The token cache is being invalidate because project 352acc5e0f224d89995edd47f304af40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:08:00.193908 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.194545 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.196473 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1408/2807] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:08:00 2022] DELETE /identity/v3/projects/352acc5e0f224d89995edd47f304af40 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:00.201231 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.202663 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.209981 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1400/2808] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:00.214685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.216104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.231139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80b32f-402e-4566-b4d6-117e0a5a43dc None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.233721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:00.294854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae8ab-e3b7-48ba-b4dd-cdcf93a0e344 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.295267 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.295904 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.296189 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.296459 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.297095 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.299233 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.299700 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.300350 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.300631 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.300904 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] PATH_INFO: `/v3/users/0515e09537b84e809dfe9ba8eb9ab6ba` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.302069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0515e09537b84e809dfe9ba8eb9ab6ba)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.304041 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.328280 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1401/2809] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:08:00 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:08:00.332562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.334232 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.359471 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0515e09537b84e809dfe9ba8eb9ab6ba'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.360634 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0515e09537b84e809dfe9ba8eb9ab6ba'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.369538 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0515e09537b84e809dfe9ba8eb9ab6ba'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.370776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0515e09537b84e809dfe9ba8eb9ab6ba'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.378396 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0515e09537b84e809dfe9ba8eb9ab6ba'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.401670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1409/2810] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:08:00 2022] DELETE /identity/v3/users/0515e09537b84e809dfe9ba8eb9ab6ba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:08:00.402330 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf3e9-e12d-4a79-b62f-fa3bc2fe04dc admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.416647 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:00.470455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.471194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.471705 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.472110 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.472953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.476148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.499480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1402/2811] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:08:00 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:08:00.503718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.505485 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.522161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370b709-838a-466e-9017-b6fbbf08263a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.529172 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.529998 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.530389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.530767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.531569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.533358 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.545264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1410/2812] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:00.550160 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.562899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863c506-139f-40ad-aaff-f2491de21daa admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.568333 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.568922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.569201 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.569471 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] PATH_INFO: `/v3/projects/9d2ffe995fac43a58e96dcc2638494e2/users/ff6c96f08a1b49359097ff9ea7bc4fd2/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.586690 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2ffe995fac43a58e96dcc2638494e2, user_id=ff6c96f08a1b49359097ff9ea7bc4fd2, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.589859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.605041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1403/2813] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:00 2022] PUT /identity/v3/projects/9d2ffe995fac43a58e96dcc2638494e2/users/ff6c96f08a1b49359097ff9ea7bc4fd2/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:00.609366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.620480 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe8502-4552-4476-b721-25a803c2715f admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.721512 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.723883 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.724169 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.724610 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.725328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.725500 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.727268 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.730061 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.757434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c6b0-15bb-4910-8e93-782379932a21 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.758306 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1411/2814] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:08:00.762675 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:00.765266 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.766395 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.766885 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.767483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] PATH_INFO: `/v3/projects/d9a7c2ec2f644fd0940a3332968df512` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.768841 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a7c2ec2f644fd0940a3332968df512)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.771077 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.777120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60753939-dcc6-42f1-880b-676591268919 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:00.782869 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06eb7f-b3e6-41f6-b4ae-267d254b0a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:00.783672 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06eb7f-b3e6-41f6-b4ae-267d254b0a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.784017 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06eb7f-b3e6-41f6-b4ae-267d254b0a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.784364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06eb7f-b3e6-41f6-b4ae-267d254b0a24 admin admin] PATH_INFO: `/v3/projects/9d2ffe995fac43a58e96dcc2638494e2/users/ff6c96f08a1b49359097ff9ea7bc4fd2/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.786945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06eb7f-b3e6-41f6-b4ae-267d254b0a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2ffe995fac43a58e96dcc2638494e2, user_id=ff6c96f08a1b49359097ff9ea7bc4fd2, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:00.791849 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06eb7f-b3e6-41f6-b4ae-267d254b0a24 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:00.811960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1412/2815] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:00 2022] PUT /identity/v3/projects/9d2ffe995fac43a58e96dcc2638494e2/users/ff6c96f08a1b49359097ff9ea7bc4fd2/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:08:00.832763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a7c2ec2f644fd0940a3332968df512', 'request_id': 'req-fee12f6b-707d-488a-82a3-67e151f384db'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.842112 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a7c2ec2f644fd0940a3332968df512', 'request_id': 'req-fee12f6b-707d-488a-82a3-67e151f384db'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.853085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a7c2ec2f644fd0940a3332968df512', 'request_id': 'req-fee12f6b-707d-488a-82a3-67e151f384db'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.871675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] The token cache is being invalidate because project d9a7c2ec2f644fd0940a3332968df512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:08:00.872389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.873979 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-fee12f6b-707d-488a-82a3-67e151f384db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:00.879328 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1404/2816] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:08:00 2022] DELETE /identity/v3/projects/d9a7c2ec2f644fd0940a3332968df512 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:00.883433 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:00.883887 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:00.884323 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:00.912073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:00.913626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:00.921427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:01.003083 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1413/2817] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:01.010859 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.011285 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.011443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.042364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:01.043972 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:01.052929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1405/2818] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:01.057400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.068295 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441abf4f-faf5-46f7-b64a-d700e3849c34 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.074090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.074804 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.075167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.075474 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.076506 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:08:01.076815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.078439 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.091299 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1414/2819] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:08:01.095771 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.105102 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec13846-52b7-4173-b1ad-565182d7f3f7 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.111115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.111985 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.112230 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.112504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.113208 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.115504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.146657 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1406/2820] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:08:01.151464 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.172400 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34e146-117c-43b6-a32b-3ef45c695d10 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.254969 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.255626 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.255912 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.256192 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.256840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.258971 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.284713 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1415/2821] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:08:01 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:01.289913 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.305738 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf8dcd-0f48-4c95-8c65-755a5bdcaadd admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.314733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.316419 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.318009 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.318358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.319336 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.321473 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.339605 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1407/2822] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:01.342974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.354872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1fc2d-a1e0-4814-91f6-53f20a23f569 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.359230 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1f034-988c-4e8b-80f8-8cddd21a9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.359892 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1f034-988c-4e8b-80f8-8cddd21a9463 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.360175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1f034-988c-4e8b-80f8-8cddd21a9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.360592 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1f034-988c-4e8b-80f8-8cddd21a9463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.361261 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1f034-988c-4e8b-80f8-8cddd21a9463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.363620 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1f034-988c-4e8b-80f8-8cddd21a9463 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.378061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1416/2823] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:01.382216 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.393847 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497a6a-ee11-43a2-87ed-99a0d268b545 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.400544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.401277 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.401804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.402262 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] PATH_INFO: `/v3/projects/1f747addc41941208d6175598e9b2212/users/eb82a26836f343a49acd0989218e4219/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.423403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f747addc41941208d6175598e9b2212, user_id=eb82a26836f343a49acd0989218e4219, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.426470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.436630 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:01.447596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1408/2824] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:01 2022] PUT /identity/v3/projects/1f747addc41941208d6175598e9b2212/users/eb82a26836f343a49acd0989218e4219/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:08:01.457357 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.458404 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.459076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.493563 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] MFA Rules not processed for user `eb82a26836f343a49acd0989218e4219`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:01.494875 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:01.599205 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1417/2825] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:08:01.606813 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.609212 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:01.680869 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7275-88cd-4ac3-8bd5-c26644213b2a admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.685956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfb711-50d2-48bd-8fee-1f9732700a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.686661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb711-50d2-48bd-8fee-1f9732700a02 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.687023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb711-50d2-48bd-8fee-1f9732700a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.687413 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb711-50d2-48bd-8fee-1f9732700a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.698782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfb711-50d2-48bd-8fee-1f9732700a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.700990 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfb711-50d2-48bd-8fee-1f9732700a02 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.713802 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1409/2826] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:08:01.736260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:01.746859 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:01.833470 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65a9fc-1b9b-451c-892c-0ec2dd01d839 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:01.840122 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:01.841314 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.841714 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.842089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] PATH_INFO: `/v3/users/eb82a26836f343a49acd0989218e4219` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.843496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb82a26836f343a49acd0989218e4219)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:01.846211 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:01.910091 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb82a26836f343a49acd0989218e4219'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:01.910778 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb82a26836f343a49acd0989218e4219'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:01.921120 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb82a26836f343a49acd0989218e4219'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:01.922380 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb82a26836f343a49acd0989218e4219'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:01.933127 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb82a26836f343a49acd0989218e4219'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:01.953362 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1418/2827] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:08:01 2022] DELETE /identity/v3/users/eb82a26836f343a49acd0989218e4219 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:01.957817 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:01.958085 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:01.958358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:01.977691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:01.978880 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:02.058028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1410/2828] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:02.078237 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:02.082960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:02.162478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5762-6435-41ca-b641-f92f59812e98 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:02.167575 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc47b5-70fc-4a59-99d2-7ac588ab27fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:02.168276 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc47b5-70fc-4a59-99d2-7ac588ab27fa service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:02.168809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc47b5-70fc-4a59-99d2-7ac588ab27fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:02.169025 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc47b5-70fc-4a59-99d2-7ac588ab27fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:02.180802 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc47b5-70fc-4a59-99d2-7ac588ab27fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:02.182894 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc47b5-70fc-4a59-99d2-7ac588ab27fa service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:02.194133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1419/2829] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:02.520388 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:02.534146 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:02.552629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9b2d-44ee-4ec1-be74-29a7b9adb9cb None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:02.560250 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:02.561028 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:02.561532 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:02.561879 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] PATH_INFO: `/v3/projects/1f747addc41941208d6175598e9b2212` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:02.564523 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f747addc41941208d6175598e9b2212)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:02.566606 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:02.627588 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f747addc41941208d6175598e9b2212', 'request_id': 'req-f9564114-4fb4-468d-a915-ba2089e3ce54'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:02.635636 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f747addc41941208d6175598e9b2212', 'request_id': 'req-f9564114-4fb4-468d-a915-ba2089e3ce54'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:02.642672 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f747addc41941208d6175598e9b2212', 'request_id': 'req-f9564114-4fb4-468d-a915-ba2089e3ce54'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:02.660347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] The token cache is being invalidate because project 1f747addc41941208d6175598e9b2212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:08:02.660794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:02.661654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f9564114-4fb4-468d-a915-ba2089e3ce54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:02.663774 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1411/2830] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:08:02 2022] DELETE /identity/v3/projects/1f747addc41941208d6175598e9b2212 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:02.668727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:02.669615 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:02.670035 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:02.697873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:02.699274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:02.736138 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:02.822296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1420/2831] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:02.830902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:02.831234 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:02.832429 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:02.855482 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:02.857041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:02.867153 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1412/2832] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:02.869836 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:02.883872 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a5d30-2209-4058-a409-6876cd15b8c5 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:02.888587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:02.889210 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:02.889490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:02.889766 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:02.890428 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81536) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:08:02.890731 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:02.892465 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:02.919134 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1421/2833] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:08:02.921448 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:02.929564 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe784-5a26-4903-8372-f132b29e9deb None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:02.934423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:02.935038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:02.935358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:02.935596 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:02.936323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:02.938300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:02.957735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:02.980435 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1413/2834] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:08:02 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:02.981717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:02.992929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d550-8ee5-4291-b4d5-82857716a9b8 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:03.068873 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:03.069922 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:03.070466 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:03.070812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:03.071570 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:03.073945 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:03.103373 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1422/2835] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:08:02 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:03.108144 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:03.123671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7811d-46bf-4379-a655-9238cc651671 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:03.128984 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:03.129617 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:03.129895 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:03.130170 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:03.131123 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:03.132906 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:03.146762 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1414/2836] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:03.151375 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:03.166807 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0410a-2be4-4387-9d18-d31c994b9ed2 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:03.173069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cae58-16ae-49b0-b4e8-0c5727a76941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:03.174145 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cae58-16ae-49b0-b4e8-0c5727a76941 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:03.174649 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cae58-16ae-49b0-b4e8-0c5727a76941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:03.175181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cae58-16ae-49b0-b4e8-0c5727a76941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:03.176073 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cae58-16ae-49b0-b4e8-0c5727a76941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:03.182333 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cae58-16ae-49b0-b4e8-0c5727a76941 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:03.197696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1423/2837] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:03.202215 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:03.213626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184dfb3-625a-4c50-bb29-4f1b6a1fec27 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:03.219154 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:03.219875 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:03.220158 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:03.220404 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] PATH_INFO: `/v3/projects/69a4a025dbbc4c248bd14604b4b22530/users/c1d93580e3504089b30b45ceb50dea6f/roles/67f08f193c9646cb847747a851778af2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:03.245423 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a4a025dbbc4c248bd14604b4b22530, user_id=c1d93580e3504089b30b45ceb50dea6f, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:03.249023 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:03.340241 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045a794-c868-4d7e-bb1e-4d43d37437b7 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:03.341007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045a794-c868-4d7e-bb1e-4d43d37437b7 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:03.341661 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045a794-c868-4d7e-bb1e-4d43d37437b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:03.344467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1415/2838] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:03 2022] PUT /identity/v3/projects/69a4a025dbbc4c248bd14604b4b22530/users/c1d93580e3504089b30b45ceb50dea6f/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:08:03.400765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a045a794-c868-4d7e-bb1e-4d43d37437b7 None None] MFA Rules not processed for user `c1d93580e3504089b30b45ceb50dea6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:03.403915 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a045a794-c868-4d7e-bb1e-4d43d37437b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:03.484852 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1424/2839] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:03.500177 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:03.501873 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:03.597691 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed38d-110f-413b-ac78-e6bf1a28aa37 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:03.602534 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:03.603300 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:03.603670 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:03.604015 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:03.615194 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:03.617030 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:03.634680 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1416/2840] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:08:05.994489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:05.995298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:05.995298 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:06.027645 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] MFA Rules not processed for user `ff6c96f08a1b49359097ff9ea7bc4fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:06.029628 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:06.044989 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:06.111867 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1425/2841] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:06.129365 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:06.131407 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:06.214788 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb85a-9297-4834-b9e0-432ca6bf8896 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:06.221331 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:06.221963 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:06.222269 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:06.222543 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:06.224434 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:06.289403 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:06.291011 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151a7eb-5752-4553-80a5-fe37127ac847 service nova] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:06.295887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:06.303339 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1417/2842] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:06.568722 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:06.638016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf05e7f-5867-45fb-abc7-602dfe2c9fa8 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:06.643717 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:06.644594 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:06.644733 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:06.644930 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] PATH_INFO: `/v3/users/c1d93580e3504089b30b45ceb50dea6f` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:06.646165 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d93580e3504089b30b45ceb50dea6f)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:06.648322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:06.715544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d93580e3504089b30b45ceb50dea6f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:06.716949 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d93580e3504089b30b45ceb50dea6f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:06.727581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d93580e3504089b30b45ceb50dea6f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:06.728651 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d93580e3504089b30b45ceb50dea6f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:06.743038 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d93580e3504089b30b45ceb50dea6f'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:06.772390 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1426/2843] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:08:06 2022] DELETE /identity/v3/users/c1d93580e3504089b30b45ceb50dea6f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:06.779147 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:06.779794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:06.780410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:06.823008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:06.824255 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:06.911982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1418/2844] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:08:06.924052 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:06.925711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:06.974753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:07.014297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f79c8-7c4b-4e81-bf5b-3c17301e9b99 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:07.018372 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac24ea-1c97-4e31-80fc-276d9813fcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:07.019114 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac24ea-1c97-4e31-80fc-276d9813fcee service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.019461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac24ea-1c97-4e31-80fc-276d9813fcee service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.019767 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac24ea-1c97-4e31-80fc-276d9813fcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.031721 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac24ea-1c97-4e31-80fc-276d9813fcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:07.034141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac24ea-1c97-4e31-80fc-276d9813fcee service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:07.048121 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1427/2845] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:07.484108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:07.485583 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:07.500128 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c11a9-9092-4b8a-a208-559f087ef640 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:07.506603 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:07.507288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.507742 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.508353 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] PATH_INFO: `/v3/projects/69a4a025dbbc4c248bd14604b4b22530` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.509734 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a4a025dbbc4c248bd14604b4b22530)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:07.512642 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:07.584543 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5461-8696-4158-bd44-e20962e84a27 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.584816 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5461-8696-4158-bd44-e20962e84a27 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.585088 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5461-8696-4158-bd44-e20962e84a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.598626 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a4a025dbbc4c248bd14604b4b22530', 'request_id': 'req-b0672ba3-a45a-4163-8cf2-549f87a5df28'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:07.605056 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a71a5461-8696-4158-bd44-e20962e84a27 None None] MFA Rules not processed for user `6b4ba11f5d9e4c8191bad7d8fa57be10`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:07.606351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a4a025dbbc4c248bd14604b4b22530', 'request_id': 'req-b0672ba3-a45a-4163-8cf2-549f87a5df28'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:07.606509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a71a5461-8696-4158-bd44-e20962e84a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:07.612490 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a4a025dbbc4c248bd14604b4b22530', 'request_id': 'req-b0672ba3-a45a-4163-8cf2-549f87a5df28'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:07.627625 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] The token cache is being invalidate because project 69a4a025dbbc4c248bd14604b4b22530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:08:07.627941 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:07.628602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-b0672ba3-a45a-4163-8cf2-549f87a5df28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:07.630654 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1419/2846] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:08:07 2022] DELETE /identity/v3/projects/69a4a025dbbc4c248bd14604b4b22530 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:07.635172 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.635465 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.636279 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.656848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:07.658087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:07.683421 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1428/2847] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:08:07.732016 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1420/2848] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:07.741668 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.742022 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.742300 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.764830 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:07.766408 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:07.777423 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1429/2849] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:08:07.782443 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:07.794105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df1148-ceed-436f-9f13-3c4fa0e0e45c None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:07.799422 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:07.800199 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.800560 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.800902 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.801715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:08:07.802084 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:07.803893 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:07.819493 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1421/2850] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:08:07.824234 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:07.834352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1571e-6a31-4e41-b9bf-a50dedd03079 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:07.839568 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:07.840346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.841200 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.841636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.842416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:07.844957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:07.879290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1430/2851] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:08:07 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:07.884065 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:07.896240 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3e6a3-0700-447e-9df5-16b0be40757c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:07.905660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:07.966930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:07.967717 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:07.968100 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:07.968568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:07.969346 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:07.971420 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:08.000725 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1422/2852] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:08:07 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:08.002566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:08.015629 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdff81-3d2a-42f0-b08a-1ed3084c4f29 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:08.022432 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:08.023389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:08.023809 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:08.024569 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:08.025425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:08.027706 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:08.039586 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1431/2853] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:08.044020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:08.055363 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d1af-1292-4f3d-84bd-fcd0f285610f admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:08.060763 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2053d3-81e5-4930-a335-43b85452d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:08.061504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2053d3-81e5-4930-a335-43b85452d836 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:08.062173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2053d3-81e5-4930-a335-43b85452d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:08.062173 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2053d3-81e5-4930-a335-43b85452d836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:08.063398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2053d3-81e5-4930-a335-43b85452d836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:08.064726 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2053d3-81e5-4930-a335-43b85452d836 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:08.082938 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1423/2854] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:08.086418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:08.101611 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921a33c-6ddb-4b68-9dbd-70b05319e432 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:08.107750 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:08.108652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:08.109090 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:08.109544 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] PATH_INFO: `/v3/projects/c4f70f3654754bc9a888ea3ffd0bc21d/users/b933eb2151b3447f8b477e8c0155edc4/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:08.134427 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f70f3654754bc9a888ea3ffd0bc21d, user_id=b933eb2151b3447f8b477e8c0155edc4, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:08.137854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:08.163416 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1432/2855] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:08 2022] PUT /identity/v3/projects/c4f70f3654754bc9a888ea3ffd0bc21d/users/b933eb2151b3447f8b477e8c0155edc4/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:08.237097 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:08.237355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:08.237446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:08.267455 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] MFA Rules not processed for user `b933eb2151b3447f8b477e8c0155edc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:08.268716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:08.345982 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1424/2856] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:08.357943 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:08.359893 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:08.432413 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e846-0aac-4bdd-9998-1377cb0dfe65 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:08.436687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d9b1f-873f-4467-94e8-8a47affebeff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:08.437426 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9b1f-873f-4467-94e8-8a47affebeff service cinder] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:08.438095 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9b1f-873f-4467-94e8-8a47affebeff service cinder] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:08.438576 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d9b1f-873f-4467-94e8-8a47affebeff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:08.451441 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d9b1f-873f-4467-94e8-8a47affebeff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:08.453260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d9b1f-873f-4467-94e8-8a47affebeff service cinder] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:08.472601 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1433/2857] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:18.343289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:18.459447 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:18.798733 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:18.932288 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a38a-8bc8-4e25-98f5-ad5024d67f09 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:18.937142 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:18.937828 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:18.938106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:18.938375 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] PATH_INFO: `/v3/users/b933eb2151b3447f8b477e8c0155edc4` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:18.939565 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b933eb2151b3447f8b477e8c0155edc4)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:18.941504 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:18.991909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b933eb2151b3447f8b477e8c0155edc4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:18.992574 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b933eb2151b3447f8b477e8c0155edc4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:18.993181 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b933eb2151b3447f8b477e8c0155edc4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.001371 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b933eb2151b3447f8b477e8c0155edc4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.008501 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b933eb2151b3447f8b477e8c0155edc4'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.027933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1425/2858] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:08:18 2022] DELETE /identity/v3/users/b933eb2151b3447f8b477e8c0155edc4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:19.033434 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.033864 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.034181 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.098774 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:19.100061 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:19.178874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1434/2859] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:19.189414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:19.191039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:19.237870 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:19.274739 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebf717-ca06-4334-bad7-e4bc34fcb823 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:19.279962 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8c490-61f8-4b0f-b880-5021b95018d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:19.282786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c490-61f8-4b0f-b880-5021b95018d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.282786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c490-61f8-4b0f-b880-5021b95018d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.282786 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c490-61f8-4b0f-b880-5021b95018d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.291512 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8c490-61f8-4b0f-b880-5021b95018d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:19.293018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8c490-61f8-4b0f-b880-5021b95018d4 service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:19.303224 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1426/2860] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:19.600288 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:19.601986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:19.615808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21b6c-36b3-4997-9fb8-f681186aa94a None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:19.620947 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:19.621726 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.622005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.622273 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] PATH_INFO: `/v3/projects/c4f70f3654754bc9a888ea3ffd0bc21d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.623535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f70f3654754bc9a888ea3ffd0bc21d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:19.625461 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:19.677296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f70f3654754bc9a888ea3ffd0bc21d', 'request_id': 'req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.682715 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f70f3654754bc9a888ea3ffd0bc21d', 'request_id': 'req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.689141 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f70f3654754bc9a888ea3ffd0bc21d', 'request_id': 'req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.705758 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] The token cache is being invalidate because project c4f70f3654754bc9a888ea3ffd0bc21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:08:19.706049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.706694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-9a9dad28-f3f9-4c64-a01d-4ea9be7c8571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:08:19.708286 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1435/2861] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:08:19 2022] DELETE /identity/v3/projects/c4f70f3654754bc9a888ea3ffd0bc21d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:19.713478 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.713953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.713953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.764816 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:19.766020 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:19.843958 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1427/2862] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:19.851948 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.852253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.852508 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.876175 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:19.877403 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:19.886322 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1436/2863] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:19.890821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:19.901905 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c4d9d-84a4-4afa-a833-42d4faedc8bd None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:19.908899 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:19.909848 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.910249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.910553 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] PATH_INFO: `/v3/domains` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.911244 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81537) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:08:19.911555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:19.913157 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:19.925567 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1428/2864] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Aug 24 10:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:08:19.930364 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:19.940961 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277531b-af8a-4b22-8a78-f0042a757c8c None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:19.947530 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:19.948139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:19.948411 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:19.948674 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:19.949297 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:19.951301 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:19.983535 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1437/2865] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:08:19 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:19.990355 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:20.001356 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135861b-3ee7-4f4c-bf70-1c6399ba4abb admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:20.062849 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:20.063498 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:20.063769 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:20.064034 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] PATH_INFO: `/v3/users` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:20.064703 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:20.066656 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:20.089671 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1429/2866] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:08:19 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:08:20.095271 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:20.106960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0b17e-f631-41d6-9955-05f50409b1ea admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:20.113369 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:20.114253 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:20.114681 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:20.115074 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:20.116167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:20.118952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:20.134815 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1438/2867] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:20.139983 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:20.151105 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9254a3-7572-4d8f-a33e-c9d1f7c6be5c admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:20.158782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72431d5-a2fb-4d7e-9019-2746ac523b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:20.160446 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72431d5-a2fb-4d7e-9019-2746ac523b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:20.160924 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72431d5-a2fb-4d7e-9019-2746ac523b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:20.161390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72431d5-a2fb-4d7e-9019-2746ac523b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:20.162364 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72431d5-a2fb-4d7e-9019-2746ac523b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:20.164141 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72431d5-a2fb-4d7e-9019-2746ac523b7c admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:20.176804 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1430/2868] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:20.180952 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:20.192420 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115dbde-7a39-4bf7-a228-1653ff788f6e admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:20.198608 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:20.199308 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:20.199591 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:20.199862 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] PATH_INFO: `/v3/projects/6d839b2def4d4a898e2e76bc2db16345/users/b2a70cace5474f349f921b439af6d6a1/roles/67f08f193c9646cb847747a851778af2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:20.220890 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d839b2def4d4a898e2e76bc2db16345, user_id=b2a70cace5474f349f921b439af6d6a1, role_id=67f08f193c9646cb847747a851778af2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:20.226652 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:20.228972 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:20.243810 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1439/2869] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:20 2022] PUT /identity/v3/projects/6d839b2def4d4a898e2e76bc2db16345/users/b2a70cace5474f349f921b439af6d6a1/roles/67f08f193c9646cb847747a851778af2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:20.249815 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:20.250122 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:20.250416 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:20.265315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:20.273785 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] MFA Rules not processed for user `7d891070d24d41cb9c32f1d43f5c805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:20.275008 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:20.339798 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1431/2870] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:20.350155 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:20.352581 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:20.411656 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4068-a26d-44cb-97d0-92342e61c8fa admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:20.415589 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c73758-1258-41af-b76f-3fece2cf55f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:20.416191 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73758-1258-41af-b76f-3fece2cf55f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:20.416463 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73758-1258-41af-b76f-3fece2cf55f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:20.416736 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c73758-1258-41af-b76f-3fece2cf55f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:20.427754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73758-1258-41af-b76f-3fece2cf55f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:20.429183 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c73758-1258-41af-b76f-3fece2cf55f9 service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:20.439501 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1440/2871] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:22.662833 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:22.664424 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:22.679242 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d0ec7-b847-4d2f-8d07-21e0bb990bdd None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:22.683121 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:22.684289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:22.684289 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:22.684638 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:22.686877 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:22.700805 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:22.703538 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:22.716245 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1432/2872] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:26.045921 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.046632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.046632 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.084518 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] MFA Rules not processed for user `b2a70cace5474f349f921b439af6d6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:26.086277 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:26.170365 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1441/2873] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:26.174568 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:26.186643 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54421e6c-75bc-4cac-b18c-0d96a4a8eb3b service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:26.197428 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:26.198320 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.198794 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.199325 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.200068 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:26.202380 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:26.250171 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1433/2874] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Aug 24 10:08:26 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:08:26.254718 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:26.268401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0730-5265-46d5-aa74-09e5dcc396af None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:26.351781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:26.352392 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.352938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.352938 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.353584 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:26.356489 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:26.392515 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1442/2875] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Aug 24 10:08:26 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:08:26.400183 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:26.411688 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b02af-93f0-49e9-a9e9-89b6b2ae81a3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:26.416694 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:26.417685 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.418108 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.418382 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.419039 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:26.421599 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:26.435795 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1434/2876] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:26.440291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:26.456540 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef139f1f-669d-41e4-8a74-54cc169e47e6 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:26.466119 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:26.467352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.467822 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.468158 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] PATH_INFO: `/v3/projects/1862b059bb7949f79261f6fa90a64294/users/603df5daf5254cb0aca2af5747b5037d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.482754 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:26.486911 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1862b059bb7949f79261f6fa90a64294, user_id=603df5daf5254cb0aca2af5747b5037d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:26.489960 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:26.513696 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1443/2877] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:26 2022] PUT /identity/v3/projects/1862b059bb7949f79261f6fa90a64294/users/603df5daf5254cb0aca2af5747b5037d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:08:26.518445 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:26.538389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34156293-1dfb-4a51-b60a-c870cbd5c6f9 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:26.616927 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39bd67-0bdc-48b0-a010-37b35f86c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:26.617550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39bd67-0bdc-48b0-a010-37b35f86c081 admin admin] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.617824 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39bd67-0bdc-48b0-a010-37b35f86c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.618119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39bd67-0bdc-48b0-a010-37b35f86c081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.618801 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39bd67-0bdc-48b0-a010-37b35f86c081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:26.620516 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39bd67-0bdc-48b0-a010-37b35f86c081 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:26.635031 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1435/2878] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Aug 24 10:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:08:26.636395 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:26.650493 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09da02-bfdb-4d70-8a65-e6dc4fc667ed admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:26.656537 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:26.657574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:26.658267 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:26.659007 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] PATH_INFO: `/v3/projects/1862b059bb7949f79261f6fa90a64294/users/603df5daf5254cb0aca2af5747b5037d/roles/f94a13e285524b5d988cbb296e8a4309` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:26.664401 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1862b059bb7949f79261f6fa90a64294, user_id=603df5daf5254cb0aca2af5747b5037d, role_id=f94a13e285524b5d988cbb296e8a4309)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:26.665053 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:26.680925 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1444/2879] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Aug 24 10:08:26 2022] PUT /identity/v3/projects/1862b059bb7949f79261f6fa90a64294/users/603df5daf5254cb0aca2af5747b5037d/roles/f94a13e285524b5d988cbb296e8a4309 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:08:32.291398 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62d58-8fe6-4e61-92e7-5facbe9fc14d None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:32.291930 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62d58-8fe6-4e61-92e7-5facbe9fc14d None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:32.292214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62d58-8fe6-4e61-92e7-5facbe9fc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:32.329192 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-1fe62d58-8fe6-4e61-92e7-5facbe9fc14d None None] MFA Rules not processed for user `603df5daf5254cb0aca2af5747b5037d`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:32.330782 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-1fe62d58-8fe6-4e61-92e7-5facbe9fc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:32.386956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:32.415602 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1436/2880] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:32.430776 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:32.436974 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:32.516636 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c320390-661b-4f74-bf76-cb99feb13505 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:32.521600 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0a103b9b799406fab32d0eaa4965592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:32.522232 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:32.522511 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:32.522794 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:32.605967 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:32.608189 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:32.624170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1445/2881] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:32.771343 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:32.771634 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:32.771953 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:32.807820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:32.809223 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:32.877586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1437/2882] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:32.890965 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:32.892517 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:32.967139 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23c9ee-ae32-4d42-881f-e642bcdc238b service glance] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:32.972418 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:32.973037 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:32.973316 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:32.973587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:32.983764 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:32.985425 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:32.994092 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1446/2883] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:08:35.459159 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:35.575929 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e566a2a-d324-45bb-90f9-653d6d230993 None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:35.581715 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:35.582345 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:35.582764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:35.583041 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:35.586115 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:35.681119 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:35.682827 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d28a9d-4d36-4ce2-9dd8-460e0988eacb service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:35.697466 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1438/2884] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:37.749566 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:37.751854 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:37.788219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:37.889687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf22459-b831-40ed-8909-fba312d853cf service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:37.899812 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:37.901049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:37.901049 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:37.901240 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:37.903015 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:37.923845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:37.925389 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:37.937882 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1447/2885] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:41.904037 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe859024-3750-4190-8124-227e46f1a912 None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:41.904544 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe859024-3750-4190-8124-227e46f1a912 None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:41.904839 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe859024-3750-4190-8124-227e46f1a912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:41.925259 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-fe859024-3750-4190-8124-227e46f1a912 None None] MFA Rules not processed for user `b2a70cace5474f349f921b439af6d6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:41.926467 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fe859024-3750-4190-8124-227e46f1a912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:41.933387 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1439/2886] 10.222.0.65 () {58 vars in 958 bytes} [Wed Aug 24 10:08:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:43.392336 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:43.394132 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:43.494223 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ca2cf-e4d8-43af-bbc5-e5325fd627e1 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:43.500290 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:43.500898 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:43.501178 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:43.501452 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:43.503574 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:43.516063 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:43.517735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:43.527993 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1448/2887] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:08:44.671457 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] REQUEST_METHOD: `POST` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:44.672075 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:44.672293 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:44.687562 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=100 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:44.701587 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.auth.core [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81537) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:08:44.703820 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:08:44.717932 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1440/2888] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Aug 24 10:08:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:08:44.733551 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:08:44.745513 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa74f7d-75ff-4163-92d2-113129dda4fb service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:08:44.750891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:08:44.751526 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:08:44.751808 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:08:44.752079 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:08:44.760550 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:08:44.762117 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:08:44.771449 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1449/2889] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:08:54.767597 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=80 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:08.177324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:09:08.187887 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a1f6f-6fa6-4929-b9e4-a06cb598b01f None None] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:09:08.192305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:09:08.192986 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:09:08.193284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:09:08.193548 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:09:08.203661 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:09:08.205126 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:09:08.215665 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1441/2890] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:09:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:09:18.211249 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=6 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:21.410478 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:21.420728 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aa711-3a28-4625-a78a-f1537a6e979b service swift] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:21.424355 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:21.425005 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:21.425285 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:21.425556 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:21.427453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:21.442263 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:21.443735 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77887a3e-f738-4e0e-87c0-a4e1a67c502a service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:21.455837 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1450/2891] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:25.265203 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:25.266764 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:25.353922 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c9dce-75b0-4b44-ab79-213996cd468f service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:25.357779 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc76f59ac1054c18a5e03cc0a18db502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:25.358389 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:25.358681 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:25.358935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:25.361821 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:25.378073 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:25.379555 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:25.391214 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1442/2892] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:30.416604 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] REQUEST_METHOD: `POST` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:30.417111 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:30.417214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:30.437296 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.auth.core [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] MFA Rules not processed for user `9dcbe420fec24160a3983a8c93195016`. Rule list: `[]` (Enabled: `True`). {{(pid=81536) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:10:30.438509 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:30.447779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1451/2893] 10.222.0.65 () {58 vars in 967 bytes} [Wed Aug 24 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:10:30.493629 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:30.509136 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60a5a-7218-4fe5-bd59-738bcc8a5848 service cinder] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:30.515087 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3592ce2e44b3470b8a5299295364031d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:30.515723 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:30.515999 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:30.516273 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:30.525323 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:30.526933 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:30.535193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1443/2894] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Aug 24 10:10:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:10:37.761753 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:37.827692 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed75f86-aa01-4bc9-8ed9-fcc65ec8a140 None None] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:37.832963 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:37.833595 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:37.833874 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:37.834160 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] PATH_INFO: `/v3/users/b2a70cace5474f349f921b439af6d6a1` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:37.835467 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a70cace5474f349f921b439af6d6a1)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:37.837684 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:37.888727 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a70cace5474f349f921b439af6d6a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:37.889468 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a70cace5474f349f921b439af6d6a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:37.898749 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a70cace5474f349f921b439af6d6a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:37.899398 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a70cace5474f349f921b439af6d6a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:37.907381 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a70cace5474f349f921b439af6d6a1'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:37.925840 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1452/2895] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:10:37 2022] DELETE /identity/v3/users/b2a70cace5474f349f921b439af6d6a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:10:38.158997 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:38.174483 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f769c-3205-4cf8-881a-1410747bae52 service swift] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:38.231384 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:38.232018 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:38.232298 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:38.232569 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] PATH_INFO: `/v3/projects/6d839b2def4d4a898e2e76bc2db16345` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:38.233660 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d839b2def4d4a898e2e76bc2db16345)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:38.235614 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:38.283205 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d839b2def4d4a898e2e76bc2db16345', 'request_id': 'req-6465c6ac-7691-4541-a393-5233b21164a3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.289414 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d839b2def4d4a898e2e76bc2db16345', 'request_id': 'req-6465c6ac-7691-4541-a393-5233b21164a3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.294935 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d839b2def4d4a898e2e76bc2db16345', 'request_id': 'req-6465c6ac-7691-4541-a393-5233b21164a3'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.304683 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:38.308991 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] The token cache is being invalidate because project 6d839b2def4d4a898e2e76bc2db16345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:10:38.309324 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.310225 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.312104 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1444/2896] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:10:38 2022] DELETE /identity/v3/projects/6d839b2def4d4a898e2e76bc2db16345 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:10:38.316254 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:38.318327 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:38.332886 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6191ea-dfbe-426b-a996-0b7cb8c9563a admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:38.394985 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:38.395891 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:38.396264 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:38.396643 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] PATH_INFO: `/v3/users/603df5daf5254cb0aca2af5747b5037d` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:38.398557 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=603df5daf5254cb0aca2af5747b5037d)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:38.400639 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:38.402219 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:38.450577 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603df5daf5254cb0aca2af5747b5037d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.451291 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603df5daf5254cb0aca2af5747b5037d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.460687 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603df5daf5254cb0aca2af5747b5037d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.461834 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603df5daf5254cb0aca2af5747b5037d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.469094 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603df5daf5254cb0aca2af5747b5037d'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.486305 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1453/2897] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:10:38 2022] DELETE /identity/v3/users/603df5daf5254cb0aca2af5747b5037d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:10:38.683221 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:38.684896 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:38.702038 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465c6ac-7691-4541-a393-5233b21164a3 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:38.772789 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:38.773438 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:38.773716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:38.774103 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] PATH_INFO: `/v3/projects/1862b059bb7949f79261f6fa90a64294` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:38.775402 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1862b059bb7949f79261f6fa90a64294)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:38.777347 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:38.831139 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1862b059bb7949f79261f6fa90a64294', 'request_id': 'req-15383f97-c0c6-48eb-97b4-d23445a3f843'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.838843 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1862b059bb7949f79261f6fa90a64294', 'request_id': 'req-15383f97-c0c6-48eb-97b4-d23445a3f843'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.844586 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1862b059bb7949f79261f6fa90a64294', 'request_id': 'req-15383f97-c0c6-48eb-97b4-d23445a3f843'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.859261 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] The token cache is being invalidate because project 1862b059bb7949f79261f6fa90a64294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81537) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:10:38.859582 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.860283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:10:38.861799 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1445/2898] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:10:38 2022] DELETE /identity/v3/projects/1862b059bb7949f79261f6fa90a64294 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:10:48.483387 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:48.854593 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:48.973654 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:48.975220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:49.051213 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28d263-8d75-4287-ac32-1bb288853cf2 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:49.103897 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:49.104621 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:49.104900 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:49.105170 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:49.107616 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:49.121016 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:49.123246 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:49.135238 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1454/2899] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:10:49.212872 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:49.214539 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:49.227735 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383f97-c0c6-48eb-97b4-d23445a3f843 admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:49.232390 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:49.233000 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:49.233274 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:49.233549 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:49.235778 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:49.318800 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:49.320338 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:49.334246 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1446/2900] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:49.398793 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:49.400220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:49.483069 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc4a68-1d1a-4cce-aa81-bd9a7f977d4c service neutron] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:49.488670 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:49.489313 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:49.489546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:49.489819 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:49.491841 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:49.504236 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:49.505828 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:49.518775 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1455/2901] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:50.813001 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:10:50.824692 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886655e4-4be6-4cc8-8b11-54470af9488f service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:10:50.829148 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8980803eace443d849c22a6e0781894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:10:50.829759 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:10:50.830036 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:10:50.830303 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:10:50.832294 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:10:50.843311 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:10:50.844748 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:10:50.854106 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1447/2902] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:10:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:59.514274 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=83 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:00.849410 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=40 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:12.285768 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:12.288089 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:12.306366 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8d58a-1837-4904-9d1f-0ffec21fe1fa service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:12.312198 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f32f08ac32498ba75eb4faa022f464', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:12.312927 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:12.313666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:12.313666 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:12.315458 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:12.329587 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:12.331328 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:12.344453 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1456/2903] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:12:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:12:19.281301 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:19.294511 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febed88-f5e7-45b4-b21b-00124a0bd3cd service neutron] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:19.300193 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:19.300809 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:19.301090 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:19.301361 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:19.303315 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:19.317784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:19.319480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:19.334790 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1448/2904] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:12:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:12:22.338781 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=6 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:22.604332 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:22.617978 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d3487-f35e-45e8-aa30-99458bd4eb68 service nova] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:22.623929 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:22.624779 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] REQUEST_METHOD: `GET` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:22.625496 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:22.625765 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:22.627907 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:22.641220 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:22.642973 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:22.655097 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1457/2905] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:12:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:12:22.674305 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:22.676351 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:22.752968 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e3fd5-315c-4d2e-807d-5338783ff988 service placement] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:22.757481 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:22.758118 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:22.758447 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:22.758750 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] PATH_INFO: `/v3/users/6b4ba11f5d9e4c8191bad7d8fa57be10` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:22.759861 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4ba11f5d9e4c8191bad7d8fa57be10)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:22.761811 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:22.809480 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4ba11f5d9e4c8191bad7d8fa57be10'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:22.810130 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4ba11f5d9e4c8191bad7d8fa57be10'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:22.810752 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4ba11f5d9e4c8191bad7d8fa57be10'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:22.818628 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4ba11f5d9e4c8191bad7d8fa57be10'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:22.831825 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4ba11f5d9e4c8191bad7d8fa57be10'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:22.856507 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1449/2906] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:12:22 2022] DELETE /identity/v3/users/6b4ba11f5d9e4c8191bad7d8fa57be10 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:12:23.053108 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:23.066699 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ac53b-f89d-42a0-baea-8258830aedf2 service placement] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:23.133167 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:23.133931 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:23.134214 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:23.134490 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] PATH_INFO: `/v3/projects/d74965c3b85547a7ae769f7a71bab326` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:23.135850 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74965c3b85547a7ae769f7a71bab326)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:23.137957 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:23.186546 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74965c3b85547a7ae769f7a71bab326', 'request_id': 'req-efe66a41-10fb-4d50-a2fd-7170eecfb913'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.192371 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74965c3b85547a7ae769f7a71bab326', 'request_id': 'req-efe66a41-10fb-4d50-a2fd-7170eecfb913'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.199161 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74965c3b85547a7ae769f7a71bab326', 'request_id': 'req-efe66a41-10fb-4d50-a2fd-7170eecfb913'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.218076 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] The token cache is being invalidate because project d74965c3b85547a7ae769f7a71bab326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:12:23.218346 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.218966 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.220483 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1458/2907] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:12:23 2022] DELETE /identity/v3/projects/d74965c3b85547a7ae769f7a71bab326 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:12:23.224675 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:23.226127 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:23.239747 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7636ce-df6e-4fc4-955e-25a6cdfd683e admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:23.300571 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:23.301238 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:23.301518 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:23.301784 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] PATH_INFO: `/v3/users/ff6c96f08a1b49359097ff9ea7bc4fd2` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:23.302956 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6c96f08a1b49359097ff9ea7bc4fd2)` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:23.304977 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:23.310531 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:23.362035 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6c96f08a1b49359097ff9ea7bc4fd2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.363283 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6c96f08a1b49359097ff9ea7bc4fd2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.364064 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6c96f08a1b49359097ff9ea7bc4fd2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.373720 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6c96f08a1b49359097ff9ea7bc4fd2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.383468 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.notifications [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6c96f08a1b49359097ff9ea7bc4fd2'} {{(pid=81537) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.402496 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1450/2908] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Aug 24 10:12:23 2022] DELETE /identity/v3/users/ff6c96f08a1b49359097ff9ea7bc4fd2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:12:23.581992 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Authenticating user token {{(pid=81536) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:12:23.583524 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.fernet_utils [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81536) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:12:23.597928 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66a41-10fb-4d50-a2fd-7170eecfb913 admin admin] Validating token access rules against request {{(pid=81536) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:12:23.659352 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d891070d24d41cb9c32f1d43f5c805b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0090fa1c947541c19958fa29c1afd1ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81536) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:12:23.659986 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:12:23.660282 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:12:23.660565 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] PATH_INFO: `/v3/projects/9d2ffe995fac43a58e96dcc2638494e2` {{(pid=81536) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:12:23.661743 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2ffe995fac43a58e96dcc2638494e2)` {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:12:23.663694 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] RBAC: Authorization granted {{(pid=81536) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:12:23.684790 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:23.714711 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2ffe995fac43a58e96dcc2638494e2', 'request_id': 'req-fd697088-4118-4175-acc2-e00f6e0fbb9b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.720475 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2ffe995fac43a58e96dcc2638494e2', 'request_id': 'req-fd697088-4118-4175-acc2-e00f6e0fbb9b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.726846 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2ffe995fac43a58e96dcc2638494e2', 'request_id': 'req-fd697088-4118-4175-acc2-e00f6e0fbb9b'} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.741260 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] The token cache is being invalidate because project 9d2ffe995fac43a58e96dcc2638494e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81536) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:12:23.741555 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.742229 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG keystone.notifications [None req-fd697088-4118-4175-acc2-e00f6e0fbb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81536) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:12:23.744133 dv-cinder-854272-2-smb devstack@keystone.service[81536]: [pid: 81536|app: 0|req: 1459/2909] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Aug 24 10:12:23 2022] DELETE /identity/v3/projects/9d2ffe995fac43a58e96dcc2638494e2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:12:33.398470 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:33.737845 dv-cinder-854272-2-smb devstack@keystone.service[81536]: DEBUG dbcounter [-] [81536] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:30.580284 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Authenticating user token {{(pid=81537) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:14:30.581909 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:30.655550 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf451f8-3204-4ebd-ad84-94e585ad23bb admin admin] Validating token access rules against request {{(pid=81537) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:14:30.716746 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087bb494630b463b841d23a1eaaed9d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a65be9cc173f4e8bb9e353806222cb4e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81537) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:14:30.717358 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] REQUEST_METHOD: `GET` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:14:30.717633 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] SCRIPT_NAME: `/identity` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:14:30.717903 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81537) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:14:30.719716 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.fernet_utils [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81537) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:14:30.731452 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:14:30.733047 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2609b-3fff-490f-a263-d6461cdd6278 service placement] RBAC: Authorization granted {{(pid=81537) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:14:30.742818 dv-cinder-854272-2-smb devstack@keystone.service[81537]: [pid: 81537|app: 0|req: 1451/2910] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Aug 24 10:14:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:14:40.738943 dv-cinder-854272-2-smb devstack@keystone.service[81537]: DEBUG dbcounter [-] [81537] Writing DB stats keystone:SELECT=58 {{(pid=81537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}